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Preface 


"GUIs are here now. They deliver real value and shozv where 
personal computing is headed. We think you'll decide that 
this is going to be a graphical user interface world." 

Jim Seymour, 1989 


Anyone who follows the computer industry news knows that in the past few 
years a war has evolved over who has developed the best and most popular 
software interface. Is it Apple Macintosh, Microsoft® Windows™, or IBM's 
OS/2®? These system user interfaces are a new breed of computer software that 
is revolutionizing the way computer users work. They are substantially different 
from DOS, which you may still be using on your personal computer. The popular 
belief is that these new software interfaces make our lives easier and a computer 
system "friendlier." Do they really? Well, you'll see! 

Just take a look at the press headlines. Cries of "DOS is dead, long live 
GUIs!" shout from the pages of the computer magazines and trade papers each 
week. As 1992 came to a close, PC Week (Editor's Note, December 21, 1992) pro¬ 
claimed that "All in all, it was a very GUI year.” Almost every software developer 
has jumped on the bandwagon and is building applications, tools, and utilities 
that run on Windows and (or) OS/2. 

You may not realize it yet (you will after reading this book!), but every com¬ 
puter software company's primary focus is to win the hearts and minds (and most 
of all, dollars) of customers, users, and software developers. As a computer 
software consumer, whether you’re a user or even a software developer yourself, 
you are continually bombarded with advertisements in newspapers, magazines, 
via direct mail, and even on television. You're the target of the largest computer 
advertising campaigns ever! 

Would you like to know more about what's going on between Microsoft and 
IBM behind the front lines in the user interface war? Why is software look and 
feel so important? What is the story on the intertwined past that the two largest 
software companies in the world share? In the past, Microsoft and IBM were al¬ 
lies against Apple. Now IBM and Apple are working together on a new operating 
system called Taligent™, while Microsoft is focusing on Windows 3.x and Win¬ 
dows NT™. Why have Microsoft and IBM had such a love-hate relationship? 
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Where's the substance behind all of the advertising claims that bombard you 
when you are looking to purchase computer hardware and software products? 
What makes a product easy-to-install, easy-to-learn, or easy-to-use? What do the 
tests show about the psychology of user interfaces? And, by the way, what do all 
these computer acronyms (DOS, GUI, OOUI) mean? Should you be using DOS, 
Windows, or OS/2 on your computer? How can you tell what software you want 
or even need? What about your company's software users and developers? How 
about your customers? What types of software and user interfaces do they need? 
These are complicated questions, but the user interface must be a key element in 
your software solutions and these questions will be addressed in this book. 

To whet your reading appetite even more, did you know that even well- 
known computer magazine and trade press columnists and authors feel the pres¬ 
sure of corporate advertising influence? I'm including this as an example of the 
competitive nature of the computer industry, not as an attack on any particular 
company. 
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In 1992, a journalistic scandal erupted when a well-known and well- 
respected computer author and columnist, William Zachmann, resigned his posi¬ 
tion as a columnist for two of the major computer magazines, PC Week and PC 
Magazine. It is widely believed that the reason behind his actions was the influ¬ 
ence of the advertising power wielded by Microsoft Corporation over both 
magazines' publisher, Ziff-Davis. This power was used to discourage positive re¬ 
views of IBM's OS/2 2.0 operating system and encourage positive reviews of 
Microsoft's Windows 3.0 product. Microsoft is the magazine's largest advertiser 
and OS/2 is Microsoft's main competitor. 

Zachmann felt that his editorial integrity and independence were being 
compromised. Later it was said, "Microsoft ... admitted that Microsoft had ex¬ 
pressed displeasure about articles ... Zachmann felt that he could no longer com¬ 
promise his integrity." ( Personal Computer Magazine, England, August, 1992). 
Charges from both sides flew furiously in the trade press. Zachmann now writes 
for a new magazine, OS/2 Professional. 

The dependent-yet-contentious relationship that fuels the IBM-Microsoft 
war has spread to the many smaller software companies. Independent software 
vendors (ISVs) have complained for many years that Microsoft has an unfair 
competitive advantage in the development of its software products because 
Microsoft also develops the operating systems on which Microsoft's products and 
their competitor's will run. Any undocumented functions, new or proposed 
changes, and additions to the base operating system and the graphical user inter¬ 
face can cause pain and anguish for product developers who are not aware of 
them. This situation potentially gives Microsoft's product developers an unfair 
advantage because they have prior knowledge, or the only knowledge, of certain 
functions in the operating system. 

There is some truth and science behind the hype of the GUI-OOUI war. I'll 
lead you past the look and feel madness to the key aspects of usable user inter¬ 
faces. You, the reader, deserve to know what's being done to you and for you by 
the computer industry's software designers and developers. 

You should know that you are the ultimate target of this war of user inter¬ 
faces. Do you have Windows or OS/2 installed on your personal computer(s) at 
home or at work? Have you already upgraded to the newer versions, Windows 
3.1 and OS/2 2.1? Why are new versions of all these products being developed so 
quickly? Are you a new computer user or a programmer in these environments? 
Why is Microsoft's Windows operating system so popular? What are the differ¬ 
ence between Windows and OS/2? Where are the operating systems headed in 
the next few years? What are the advantages and disadvantages of GUIs and 


Preface 


XV 



OOUIs? How are they different? How can GUIs and OOUIs help you as a user 
and a developer? If you're interested in finding out, then this is the book to read. 


Why Read This Book? 

This book should help you understand what a user interface really is, and why 
it’s so important from both the user and developer perspective. The user interface 
of any product, especially a software program, is probably the most important 
part of the product, at least to users. You'll find out why the user interface is so 
critical to computer software. The user interface must be designed for (and even 
designed by) users of a product. When users get frustrated and confused while 
using a software product, the problem usually lies in the user interface. 

Answer this question if you can—if today's operating systems are so easy to 
use, then why are there always new products being developed to make popular 
programs and their interfaces simpler and easier to use? This book answers this 
question. You'll also learn why any one particular product or user interface can't 
always be the best for everyone. 

This book should be of interest to software, information, and interface pro¬ 
grammers and designers (and also software project managers) and will help them 
do their jobs better. Programmers and designers must have the utmost concern 
for the usability of their products and the interfaces they present to users. Soft¬ 
ware users and other interested readers will get more out of the software they 
use, since the more they learn about user interfaces, the better they will under¬ 
stand what makes interfaces consistent and what their good and bad points are. 
A major theme of this book is " Know thy users, for they are not you!" Computer 
users have become extremely consumer-oriented and software products must fit 
how their users' function in their own environments or risk developing an un¬ 
successful product. You'll learn that the best interface is the one that lets users do 
what they want to do, when they want to do it, and how they want to do it. 


What's In This Book? 

This book discusses interfaces in general and focuses on today's graphical user 
interfaces (GUIs) and object-oriented user interfaces (OOUIs). Discussions are 
supplemented with examples and pictures of interfaces and objects that demon¬ 
strate the different operating system and user interface styles and elements. The 
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Know Thy Users, for They Are Not You 


book details the key user interface design principles, guidelines, and a basic user 
interface design process you can follow. 

The psychology of computers and the history of user interfaces will be ad¬ 
dressed, from the command line interface of DOS to the GUI and OOUI interfaces 
you see today. The book also covers the direction of future computer technolo¬ 
gies, such as multimedia, mobile computing, and pen-based systems. In the last 
few years, whole new areas of technologies and interfaces have come to the fore¬ 
front of computing. The acronym list includes new terms such as MUIs (Multi- 
media User Interfaces), PUIs (Pen-based User Interfaces), and even VRUIs (Vir¬ 
tual Reality-based User Interfaces). I'm sure that there will be more new 
acronyms and new terms to come as computers become more involved in our 
lives. How well you can interface with computers and electronic appliances in 
your own environment is an indication of just how successful you will be in the 
computer-filled 1990s. 





The Perspective of a Psychologist 


This book is based on my experiences as a user interface designer and usability 
professional for over ten years in the computer industry, and, especially, my 
training and experience as a cognitive psychologist. I've been involved in the de¬ 
sign and testing of all aspects of computer hardware and software, from product 
installation, online and hardcopy publications, to software user interfaces them¬ 
selves. 

I've spent hundreds of hours watching people try to use computers in us¬ 
ability labs and in their own work environments. Over the years, users have 
gradually migrated from command-line interfaces to graphical user interfaces 
and onward to object-oriented user interfaces. I've seen the frustration (and only 
occasionally the joy) that users experience in their work with computers. The in¬ 
sights I've gained regarding this intricate and very interesting relationship formed 
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between humans and computers should help you focus on the user's perspective 
and how software must be designed to meet the user's needs, not the designer's 
or programmer's needs. 

Cognitive psychologists bring an understanding of how humans read, learn, 
and think to help design computers to work within the psychological capabilities 
and limitations of the humans for which they are designed. In addition to user 
interface architecture design and consulting, I helped define the direction for IBM 
in the area of multimedia computing, by designing a multimedia kiosk interface 
that shows video clips of both new movies and the classics to in-store customers. 
The interface also allows them to find information about movies they are inter¬ 
ested in and even recommends other movies based on their viewing preferences. 

Throughout the book, important information to focus your 
attention will be highlighted with the KEY IDEA graphic shown here. 


Windows and OS/2 Terminology 

Windows 3.x is commonly referred to as an operating system, just as Windows 
NT and OS/2 are. In truth, Windows version 3.x, by itself, is not an operating 
system. It is a graphical environment (Microsoft's terminology) that is an extension 
of DOS, and, most importantly, you must first have DOS installed on your system 
to install and run Windows and application software developed for Windows. 
On the other hand, Windows NT and IBM's OS/2 are operating systems - they can 
be installed directly on your computer. In addition, OS/2 2.1 includes both DOS 
and Windows 3.1, but they're not essential to running OS/2. 

When I discuss the Windows interface, this addresses both Windows 3.1 and 
the new Windows NT interface. Although there is a tremendous difference under 
the covers, the interface for both Windows 3.x and Windows NT is basically the 
same. Author David Miller ( DEC Professional, March 1993, p. 40) commented on 
an early-release version of Windows NT, "...it looks like Windows 3.x. If you use 
Windows 3.x on your PCs, you'll have no trouble figuring out NT." This book 
discusses the intimate user interface aspects of both the Windows and OS/2 en¬ 
vironments. 


Theo Mandel, Ph.D. 

8001 Two Coves Drive 
Austin, Texas 78730-3125 
(512) 345-2259 phone/FAX 
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You and User Interfaces: 
The Real World 


"We are surrounded by large numbers of 
manufactured items, most intended to make our 
lives easier and more pleasant. In the office we 
have computers, copying machines, telephone 
systems, voice mail, and FAX machines. In the 
home we have television sets, VCRs, automated 
kitchen appliances, answering machines, and 
home computers. All these wonderful devices are 
supposed to help us save time and produce faster, 
superior results. But wait a minute—if these new 
devices are so wonderful, why do toe need special 
dedicated staff members ('power users’ or 'key 
operators') to make them work? Why do we need 
manuals or special instructions to use the typical 
business telephone? Why do so many features go 
unused? And why do these devices add to the 
stresses of life rather than reduce them?" 


Donald Norman, 1988 



Your Experiences and Expectations 


You probably haven't thought about it in this way, but everything you physically 
do is a series of interactions with objects that surround you at home, at work, or 
wherever you are. How you interact with things around you is determined by 
your past experiences with these objects (and other objects like them) and your ex¬ 
pectations of how things should work when you use them. 

For example, when you walk up to a door you just walked through a few 
minutes earlier, you don't expect to find the door locked when you turn the knob 
and push (or pull) on the door handle. You base your actions on what you expect 
to happen, even if you have never interacted with that particular object before 
(Figure 1-1). As a cognitive psychologist, I know how people deal with the world 
around them and how they handle complex situations and new experiences. 



Figure 1 -1 . User Interfaces in Your Everyday World 
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People try to simplify the world around them and they relate new or un¬ 
known things to objects and experiences that they know and are comfortable 
with. In simple terms, people know how to act with the things around them and 
when confronted with things they don't understand, they tend to relate them to 
things they do understand. They then react to them in some manner consistent 
with the way they think that type of object behaves. The best way to confuse or 
scare someone, or make them laugh, is to give him or her a familiar object but 
change the behavior that normally accompanies that object. This is one of the 
foundations on which comedy and suspense are based. If you pick up a gun and 
p ull the trigger, you expect it to make a loud noise and shoot a bullet. Imagine 
your surprise when it turns out to be a cigarette lighter and a small flame comes 
out of the gun barrel! 

Your past experiences and expectations are what film directors plan on when 
they try to amuse or scare you by changing the behavior of common objects in the 
film world. This may be amusing to a viewer of a movie or a television show; 
but when something unexpected happens while you are working on your com¬ 
puter, it isn't amusing anymore. It is frustrating, annoying, and can sometimes be 
dangerous! 

Don Norman wrote a very popular book originally titled The Psychology of 
Everyday Things (1988). Norman describes many of the everyday situations where 
something goes wrong with our interactions with poorly designed objects around 
us. Doors in public buildings are good examples of objects often designed for 
aesthetic effect rather than for actual use. How many times have you walked up 
to a door in a building you've never been in and pushed on the door to open it 
only to find that you should have pulled on the door instead? We often say, "I 
can't figure out how to use this product. What's wrong with me?" 

For some strange reason we tend to blame ourselves before we blame the 
products we use. As Norman points out, "Humans, I discovered, do not always 
behave clumsily. Humans do not always err. But they do when the things they 
use are badly conceived and designed. Nonetheless, we still see human error 
blamed for all that befalls society." In the product usability tests I've conducted, 
it is very interesting to see how people tend to blame themselves rather than the 
products they are using. After all, these software products we use are developed 
by experienced professionals, right? We try to protect the computer from harm, 
rather than being concerned that the computer might actually do us (or our in¬ 
formation) harm! This tendency is so strongly ingrained that before conducting 
product usability tests, human factors and usability testing professionals always 
instruct people that the product is being tested, not the user, and that there is 
nothing they can do that can harm the computer. 
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Even Norman himself failed to fully understand the past experiences and 
expectations of readers and potential readers of his book. Norman's original book 
was well-known and commonly called by the acronym "POET," from the first 
letters of The Psychology of Everyday Things. However, the paperback edition of 
the book was retitled The Design of Everyday Things. Retitling a book in subse¬ 
quent editions is a very rare occurrence. In the preface to the new edition, 
Norman describes how he was surprised to learn that while the word "psychol¬ 
ogy" in the original title was liked by the academic community, it was widely dis¬ 
liked and misinterpreted by the much larger audience of potential readers, the 
business community. Norman, a guru of usable product design, had been fooled 
by his perception of the book's audience. This anecdote shows the importance of 
designing products that meet user needs based on their experiences and expecta¬ 
tions in their different social, cultural, and business environments, rather than be¬ 
ing based on the product designer's viewpoint. 

Norman has also published a new book. Turn Signals Are the Facial Expres¬ 
sions of Automobiles (1992), that goes further into the "plight of humans confront¬ 
ing the perversity of inanimate objects." As you can guess, he isn't happy with 
what he sees! Many designers and psychologists share this same viewpoint, and 
we hope that you will become more aware of product and interface design 
through our books. 

I'll be discussing how our past experiences with the real world and with 
computer hardware, operating systems, and programs merge with our expecta¬ 
tions of how things should work when we try to do our tasks. The process of de¬ 
veloping products is really much more of an art than a science, and we need to 
know much more about who our users really are, what tasks they are trying to do, 
and how they use their computers. 

Here's an example of how real-world cues can actually confuse users. A bar 
in Boulder, Colorado called the Dark Horse is noted for its unique rest rooms. 
The men's and women's rest rooms are located side-by-side, with adjacent doors. 
The doors are marked MEN and WOMEN, giving patrons a strong cue as to 
which door they should enter. However, each door also has a hand pointing to 
the other door (see Figure 1-2). Which set of cues should people believe? Should 
they follow the word MEN or WOMEN on the door, or should they follow the 
hand pointing to the opposite door? The two sets of cues are conflicting. There is 
usually quite a crowd around the bar near the rest rooms, just waiting for people 
to walk up to the rest room doors, stop in their tracks, and try to figure out which 
door to go in. I won't tell you which is the correct rest room door, you'll just have 
to stop by the Dark Horse bar in Boulder! 


4 


The GUI-OOUI War: Windows vs. OS/2 




Figure 1 -2. Confusing Interfaces in the Real World 


* Even though this interface was intended to confuse users, it 

shows how ambiguous and conflicting cues can cause user confusion. Interface 
cues should give users an idea of the object's form and function and should allow 
them to determine their appropriate behavior. In this case, many customers ac¬ 
tually wait for someone to come out of one of the rest rooms before they make 
their decision about which door to enter. They assume that if someone comes out 
of one of the doors and doesn't look embarrassed, they feel safe in following 
someone else's decision. 
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"What concerns him most is that much modern technology 
seems to exist for its own sake, oblivious to the needs and 
concerns of the people it was supposedly meant to serve." 


Don Norman, 1992 


Everyone carries around his or her past experiences like a set 
of permanently attached luggage. You interact with computers like you interact 
with everything else in the world. You have some idea what a computer can do 
and you have some idea whether or not a computer can help you at all in any as¬ 
pect of your life. Many people hate computers and are proud to say that they are 
computer-illiterate. Much of this fear of machines and computers is based on 
frustration and anger from interacting with poorly designed products like the 
ones I discussed in the previous section and Don Norman talks about in his 
books. My mother and my wife both belong in this category. They believe that 
they don't need computers in their lives, but they don't really know just how 
computers have already infiltrated their lives and how they wouldn't want to 
give these things up even if they knew they were really those "damn computers." 
It's interesting how people personalize computers and speak as if there were an 
animate being inside of the computer! 



Figure 1-3. Your Experiences 
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I'd like to use my mother as an example, and I hope she doesn't mind. Many 
years ago, my sister and I were home for Christmas vacation and were amazed 
that our parents did not have a microwave oven in the kitchen. I had bought a 
microwave after spending my first summer in Texas in 1983. Texas summers are 
so hot that it is impossible to even think of turning on a regular oven in the house. 
So I went out and bought a microwave. We asked my mother why she didn't 
have a microwave and she replied, "What do I need it for? When I cook, what's 
wrong with the oven or stove top? I'm comfortable using them, and I don't want 
to try something different." We asked her how she defrosted frozen foods or 
made a cup of tea, or warmed up a mug of cold coffee. She told us how she did 
these tasks and we tried to convince her how easy they would be with a micro- 
wave, but she wouldn't believe any of it. Actually, she didn't believe that she could 
(or would want to) learn to use a microwave oven. 

Secretly, my sister and I went out and bought a countertop microwave oven, 
rearranged her kitchen counter and installed it, and then asked her into the 
kitchen to make a cup of tea. After her initial shock over the fact that we dis¬ 
rupted her kitchen organization, we showed her how to use the microwave to 
warm up a cup of hot water. She then made herself and my father a cup of tea 
and was surprised how easy it was! Now, years later, she uses the microwave 
with no problems and it has become an integral part of her kitchen. She doesn't 
look at the microwave oven as one of those "computers" that she can't use. 

Most of you will agree that the controls on a microwave oven aren't too in¬ 
credibly complicated and that you know what the basic functions are on your 
microwave at home or at the office. However, you also know that there probably 
are more advanced functions built in to your microwave oven, but you either 
haven't had the need for those functions, or most likely, you haven't taken the 
time or energy to understand how to use them. 

My father was another computer-naive consumer. He was a professor of 
English and Technical Writing at the University of Colorado at Boulder. He wrote 
over twenty-five books in his career, ranging from a dictionary of science, to 
books on technical writing, to literary critiques of contemporary European novel¬ 
ists and poets. He used an electric typewriter to write his books (he still typed 
with only his two index fingers) all of those years until we decided to buy him a 
combination typewriter/word processor. Unfortunately, the word processing 
product and its interface were so bad that he used this expensive piece of equip¬ 
ment only as a typewriter. I couldn't blame him. If the product were designed as 
an enhanced typewriter with the added features of a computer, he might have 
been able to use it. However, it was designed after a word processing program 
and it was built into some hardware that could also be used just as a typewriter. 
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My father did not have the computer skills that users were assumed to have by 
the designers of the product. That's how you get complex consumer devices that 
are used in only their simplest states by frustrated users. 

I would guess that we all agree that the "most frustrating and hated elec¬ 
tronics device" award probably goes to the videocassette recorder (VCR), and its 
remote control, for the uncanny ability to make operations that should be so 
simple, such as setting the clock, so difficult that many people just leave the digi¬ 
tal clock flashing "12:00 AM." It is amazing that so many people have spent 
hundreds of dollars for VCRs they can’t even use! 

I recently bought a new VCR and can't believe that it comes with a 32-page 
instruction manual! It even has a Quick Reference Card (QRC, for you computer 
users) with simplified instructions for common VCR tasks. The technology (or at 
least the terminology) in your basic VCR is unbelievable-my VCR has a 
"double-azimuth 4-head video recorder/playback system" and a "cable- 
compatible digital synthesizer tuner with automatic channel programming." 
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This amazing piece of electronic technology can even store six recording 
programs for up to a year. How unfortunate that most of us can't even figure out 
how to program the VCR to tape a television show or movie while were watch¬ 
ing another! In Chapter 2 I'll discuss this new "Techno-culture" that has arrived. 

The awful truth is that if microwave ovens, VCRs, and other computerized 
home appliances are that difficult to use, how can we expect people to easily use 
our computer products? Microwaves and VCRs aren't anywhere near as compli¬ 
cated as today's computers. The crazy thing is, we do have the technology and 
knowledge to make VCRs and computers easier to use for consumers and users. 
Only recently have designers and manufacturers begun to really pay attention to 
their users' needs and the usability of the design of their products. I'll discuss this 
further in the next section on usability. 

Computers are becoming an integral part in more of the 
things you use every day, such as household appliances, security systems, TVs, 
telephones, VCRs, stereo systems, and automobiles. As computer chips and cir¬ 
cuits become smaller and cheaper, they will be built directly into most of the me¬ 
chanical and electronic consumer products that you purchase. As products be¬ 
come more and more functionally complex, unfortunately it usually becomes 
more difficult to use all of these wonderful features. All products, including 
computer software products, require careful attention to the tasks that users will 
be doing with them. In fact, do designers and manufacturers even know if users 
need or want these new features? 

As one of the many business travellers who spends more time in airplanes, 
rental cars, and hotels than I care to admit, I constantly come across new features 
in many of the things I encounter on my business trips. I'm sure the rental car 
agencies are getting very tired of customers with the car keys in their hand walk¬ 
ing back up to the rental counter, saying sheepishly, "I can't get the car started!" It 
just so happens that in the past few years, safety features that are not always in¬ 
tuitive to drivers have been designed and built into new cars. For example, 
newer cars require that the driver press on the brake pedal before the engine will 
start. If you are not used to driving a newer model car, this feature is not obvious 
and requires you to somehow decipher how to start the car. 

The use of computers in sophisticated equipment like automobiles has made 
life easier for everyone involved, from the designers and manufacturers of auto¬ 
mobiles to car owners, drivers, and service technicians. This trend won't stop 
here and it certainly shouldn't stop where we are today. Many of the objects in 
your world are now computerized. These items include your television, telephone. 
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phone answering machine, FAX machine, microwave oven, and many other home 
and work devices. These things make your life a little easier, but they still require 
a lot of work on your part. 

For household and office devices to be truly helpful in your everyday life, 
they will need to become automated in order to intelligently do productive work for 
you. By automated, I mean that products themselves will be able to do most of the 
routine mental or physical tasks that you still have to do today in order to use 
them. For example, wouldn't it be great to have an automatic coffee maker that 
calculates exactly how much water and coffee to use, and even measures it for 
you, after you only tell it how many people will be drinking coffee and how 
strong you would like it to be. Only then will today's computerized objects be¬ 
come the electronic appliances we all envision we'll be using in the future. 

Peter Coffee (1992) explained, "That's the difference between merely 'com¬ 
puterized' and being actually 'automated.' Your new car won’t drive you home: 
You have to know one heck of a lot to make it do anything." I am still waiting for 



Figure 1-5. The Automobile of the Future 
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for the car that is smart enough to tell me, "I know you're travelling to San Anto¬ 
nio today, but you don't have enough gas to get there. You'd better stop along the 
way in San Marcos to get gas. By the way, it's going to be messy weather today, 
so you'd also better fill up the window washer fluid when you get gas. Now just 
sit back and relax and let's go for a nice drive." We're not quite there yet, are we? 


Usability: Success or Failure for Today's Products 


"Looking back, I want to suggest that 1992 was The Year of Usability 
Certainly this was the year that vendors talked a lot about usability 
The whole notion of usability is simply a 1990's restatement of the 
old ease-of-use argument (aka user-friendliness) that has wound 
throughout the history of the PC hardware and software business." 

Jim Seymour, 1992 


The computer industry goes through cycles of popular buzzwords or catch- 
phrases that focus on the current technology trends and, hopefully, user needs in 
the computer industry It is interesting to note that these phrases are very closely 
related to the software user interface for computer products. M User-friendly n was 
the most popular phrase for quite a few years, but now the current popular fla¬ 
vors of phrases seem to be "object-oriented" and "multimedia." All of these 
catchphrases have been used (and abused ) over the past few years to market and 
sell computer products. See some of the advertising slogans in Figure 1-6. 

Unfortunately, ease-of-use for a product developer is very different than for 
the product's users. Jim Seymour (1992a) notes that lip service has been paid to 
product usability for many years, but that finally the importance of the idea has 
caught on and spread through the computer industry. I want you to remember 
that there are multiple views on the usability issue. First, there's the product de¬ 
veloper and manufacturer's view (how the product is designed and built). Sec¬ 
ond, there's the user attitudes (what you think about a particular product). Fi¬ 
nally, there is the user performance view (how you perform your tasks with the 
product). 
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EXTRA!!! Stye ©imes EXTRA!!! 


Advertising Promises 


"No wonder 
WordPerfect users 
prefer Word for 
Windows. It has 
easy written all 
over it." Microsoft 
Corporation 

"I’ve got more 
important things to 
do than figure out 
how to use a 


computer." IBM 
Corporation 

"Some things are 
easier to use than 
Tax Preparer." 
(pictured with a 
comb, matches, 
scissors, fly 
swatter, push-pins) 
HowardSoft 


"Project manage¬ 
ment just got a 
whole lot easier." 
AGS Management 
Systems 

"Microsoft 
Windows: Makes 
your PC easier to 
use." Microsoft 
Corporation 


"Macintosh: 
Designed on the 
principle that a 
computer is a lot 
more useful if it’s 
easy to use." 
Apple Computer, 
Inc. 



Figure 1 -6. Popular Advertising Slogans 


Even household appliances are beginning to follow the ease-of-use trend. In 
an article titled, "Simpler But Better" in Appliance Manufacturer magazine (1992) 
the headline reads, "Appliance Makers Heed Consumers' Cry: 'We Want Easier- 
to-use Controls.'" The microwave ovens I talked about in the last section are get¬ 
ting even easier to use for computer-avoiders like my mother. It seems they are 
becoming more task-oriented than function-oriented as they have been in the 
past. This distinction is important and I'll discuss it later in this section. 

Instead of trying to figure out exactly how long to cook your microwave 
pizza, you might push a button labelled "Pizza" that is preprogrammed to auto¬ 
matically cook for a set time period. There may also be buttons that are labelled 
"Reheat" and are preset for a few convenient time periods such as 15 seconds, one 
minute, and two minutes. Isn't this great? Today, don’t you find yourself con¬ 
stantly reheating something for just a few seconds or minutes at a time to cook a 
little longer, but not so long that it is overcooked or too hot? These "Reheat" but¬ 
ton time periods can even be reset by consumers at any time. These usability 
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improvements are (supposedly) the result of years of research and development 
by appliance manufacturers. A spokesperson for Whirlpool Corp. states, "These 
new controls have been tested extensively both in the laboratory and in the field 
to ensure maximum ease-of-use and eye appeal. They have consistently out- 
scored other designs, both competitive and our own, with users saying they are 
much easier to understand and operate, easier to clean, and better looking." It's 
about time, right? 

Computer companies now attempt to distinguish their products not on the 
functions they provide, but on how easy it is for users to learn and use the prod¬ 
uct. The focus has changed from "bells and whistles" to usability. Actually, we 
buy products based on their iperceived usability. Just pick up any computer 
magazine and look at the advertisements for any software product. They will 
state that their products are easier to learn and easier to use than their 
competitor's products. We often base our buying decisions on these usability fac¬ 
tors. Unfortunately these marketing promises often don't come true when we ac¬ 
tually try to use these products to do the work we'd like to do in our businesses or 
in our homes. It is at this point, when products don't work the way users expect 
them to, that people get extremely frustrated and upset. 

According to the trade press (World News Today , 1992), Microsoft thinks that 
the value customers place on product usability is a key to sales success. 
Microsoft's latest advertising slogan is "Making it easier." Take a look in any 
computer magazine. Just what do you think about this type of advertising? Does 
it make you want to purchase these products because the company advertising 
says that the product is more usable than its competitors? How can you be sure of 
the advertising claims? How can you as a user judge these claims for yourself? 
The PC magazines and journalists help bewildered consumers and users by pro¬ 
viding product reviews, tests, and comparisons. Most readers feel better about 
making purchasing decisions when they have more reliable information than just 
that which they get from product advertising. 

How do software developers provide the ease-of-learning and ease-of-use 
that users demand today? How do you design programs so that they are consis¬ 
tent both within themselves and consistent across your user environment with 
other programs? When users perform an action or a keystroke that saves their 
data in one program it should not delete their data in another program! The user 
interface models and design principles outlined later will help you better under¬ 
stand computers and better design computer software products. This way, users 
can perform their work tasks with a high degree of productivity and pleasure. 

J. D. Powers and Associates conducts periodic polls of computer users on 
their satisfaction with desktop computer systems. The interesting thing about 
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Figure 1-7. How To Sell Your Product-Just Say "User Friendly!" 


these surveys is the areas that contribute to a user's definition of customer satis¬ 
faction. System ease-of-use is the top factor, commanding a full 45% of users' 
overall satisfaction. Following that, the other factors contributing to user satis¬ 
faction were system capacity, operation, quietness, and repair service. These 
types of surveys show how users define their satisfaction criteria, and how 
product developers should pay more attention to how their users define customer 
satisfaction, rather than how they define it themselves. 


Defining Product Usability 

How do you define user friendliness? How can companies say that their prod¬ 
ucts are easier to use than competitive products? Usability is a subjective notion. 
The term "user friendly" has no real meaning unless it can be defined in real 
terms. Usability must be specifically defined so that accurate evaluations of 
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products can be made. Only then can the "easy-to-use" label mean anything to 
product consumers and users. The field of human factors and usability testing is 
based on the process of defining the measures that make up product usability. 
These measures are then used to evaluate how well products perform when users 
try to do the tasks they'd like to do with the products. The area of usability test¬ 
ing and specific user interface testing results will be discussed later. 

Educators and researchers agree that there is a current trend in the computer 
industry to use the term usability very loosely. Anderson and Shapiro (1989) say 
"'User friendly' has become so lacking in content and specificity as to be virtually 
meaningless." They propose general categories that can be used to get a better 
definition of usability to be applied to computer software in different user and 
system environments. You can use these categories to help better define software 
usability for you or your business . These "Easy to ...” categories are as follows: 


1. Easy to use 

2. Easy to learn (and teach) 

3. Easy to relearn 

4. Easy to unlearn 

5. Easy to avoid harm 

6. Easy to support 

7. Easy to audit 

8. Easy to share within a group 

9. Easy to integrate into existing operations 

You may be able to use these categories to develop questionnaires, checklists, 
or guidelines to evaluate the software products you purchase and use. I've found 
that if these categories are too specific, you can subdivide usability into four gen¬ 
eral areas that have been defined by Shackel (1984): learnability, effectiveness, 
flexibility, and user attitude. 


KEY IDEA! 


In past years, developers improved software products by 
adding more function to their products. In fact, to sell products, the competitive 
focus was on the amount of function in a product, with little concern about how 
users were supposed to use these functions. The focus on program function has 
changed to a focus on tasks that users perform. 


This focus on user tasks is also seen in both the hardcopy and online docu¬ 
mentation that accompany software products. Documentation that used to be 
organized by program function in user guides and reference manuals is now or- 
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ganized and grouped by tasks. Users can now find information by looking up 
terms that they are more familiar with, rather than program function names or 
function syntax. This trend has enabled printed documentation, online informa¬ 
tion, help, and tutorials to become more accessible and usable for technical sup¬ 
port service personnel and users. 


What about the Usability of Your Information? 

Let's switch modes and talk about the usability of your information to you and 
your audience, rather than the usability of the products you use to work with your 
information. How do you get people to really understand and feel some emotion 
about your information? Here's an example of how important the usability of 
information is, in addition to the actual content of the information itself. 

A recent article (Miller, 1992) tells about an attorney in Houston, Texas, who 
now uses PC software programs to generate visual charts and aids to use in court 
rather than the standard oral presentations and traditional paperwork used by 
most of the legal profession. Attorneys are finally realizing that the information 
they are trying to present can be greatly enhanced by presenting it to judges and 
jurors in a visual and graphic way rather than by simply verbally stating the 
numbers or concepts. One attorney used a laptop computer to generate three- 
dimensional charts on a screen in the courtroom to present the conclusions of a 
witness. The attorney stated, "This real-time display at least doubled the effec¬ 
tiveness of the witness' testimony." 

Why product design needs to be driven by users and how this can be done is 
one of my key concerns. That is, how information can be presented (the user in¬ 
terface) in the most effective way (ease-of-learning and ease-of-use) and what is 
the best presentation vehicle (for example, using multimedia) to help facilitate 
comprehension and understanding. Let's now define what I mean by the term 
user interface. 
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What Is a User Interface and Why Do You Care? 


"Most humans do not desire to interface with the computer per se. 
But curiously , many of these same people, who don't want to interface 
with the computer, will spend hours interfacing with a one-armed 
bandit in Las Vegas, or interfacing via remote control with their 
television set, or interfacing via automobile with the road. 

What is it about a computer that makes us so anti-interface? " 

David Hohn, 1992 


What is an interface? People use the word in so many different ways-it has been 
used as a noun for quite a long time and more recently it has also been used as a 
verb. Today, people interface with each other, which means they communicate in 
some way, either in person, on the telephone, or even electronically using com¬ 
puters. The user interface is the area in which a user and an object come together 
to interact. 

A computer user interface is the computer hardware and software that pre¬ 
sents information to users and allows users to interact with the information and 
the computer. According to IBM's Common User Access (CUA) user interface 
guidelines (IBM, 1992), "A user interface is the set of techniques and mechanisms 
that a person uses to interact with an object. Any kind of object has a user inter¬ 
face, and an object's interface is developed according to a user's needs and rea¬ 
sons for using the object." 

The computer user interface includes the hardware that makes up your com¬ 
puter system, such as the keyboard, a pointing device like a mouse, joystick, or 
trackball, and the display screen itself. The software components of the user inter¬ 
face are all the items you see, hear, point to, or touch on the screen to interact with 
the computer itself, as well as the information with which you are working. It 
takes a careful crafting of the hardware and software interface components to al¬ 
low you to communicate with a computer and allow the computer to present in¬ 
formation to you. 

As you can tell from what I've discussed so far, the design of the user inter¬ 
face for a product is critical to its user acceptance and success. Without a 
well-designed user interface, even a system with outstanding features will not be 
successful. Too often, product developers think that the role of the user interface 
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"I'm the user-friendly interface between Mr. Grimbly and the world." 


is simply to dress up the program's functions. As Norm Cox (1992), a well-known 
user interface design consultant from Dallas, Texas, says, this effort is much like 
trying to "put some lipstick on the bulldog." 

This is often the case when developers attempt to update older products or 
programs that were originally developed on a host mainframe (large system) 
computer. In many cases, developers don't want to change the design or imple¬ 
mentation of the program. They simply want to put a more usable and more 
graphic "front-end" on the program to make it easier for users. There are many 
development tools that enable developers to build personal computer-based user 
interfaces to mainframe programs and stored data. All too often the effect isn't 
optimal, and as Norm Cox says, you end up with an ugly program with a pretty 
face! 
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Building a front-end user interface can be effective as long as it doesn't force 
the user to do things a certain way because the program needs to have the infor¬ 
mation or actions completed in a certain order. However, in most cases, the best 
way to give the user a better product interface is to design the whole software 
product from the ground up with the user's beliefs, wants, needs, experiences, and 
expectations used as the basis for product development. 

Now you should realize how everything you interact with in your world has 
a user interface or is a part of a user interface. A user interface for an object might 
be a set of buttons like those on a telephone, radio, soft-drink machine, or video¬ 
cassette recorder. We've already discussed how difficult it is to use a VCR. I hope 
now you can look around at the objects in your environment and can see their 
user interface aspects. Then judge for yourself just how usable most products re¬ 
ally are! Have you used the Automated Teller Machine (ATM) at the bank or the 
mall lately? How do you feel about the automated phone systems you find these 
days when you call a bank to find out your account balance, when you call the 
phone company, or when you call the airlines to get flight arrival and departure 
information? 

Today's telephone interfaces are a modern form of a computer menu inter¬ 
face (I'll discuss menus in more detail later). The designers of these systems know 
they have a difficult task in developing these interfaces because almost all of the 
people using the system would much prefer to be talking to a human being rather 
than listening to a computer or a recorded voice asking them to "Press 1 and the 
star button now." I called the telephone company just recently to ask about a 
charge on my latest telephone bill. The first thing I heard was a recorded voice 
saying, "Thank you for calling Southwestern Bell." Of course, I wasn't thrilled to 
hear that recording because I knew that I was at the beginning of the new game 
called, "Can you find a real human being at the other end of the phone?" 

If you've used these automated phone systems often enough, you've prob¬ 
ably learned by now that there is a way to avoid getting entangled in the push¬ 
button mess of menus. The secret is to not press any buttons and see if you get 
through to a person on the other end of the phone just by staying on the line. This 
is a quick usability test of the user friendliness of an automated phone system! 
Unfortunately not all automated systems are that easy to bypass. Many systems 
force you to navigate through a number of choices and automated menus, and 
only then are you asked, "If you wish to speak to a service representative, press 6 
and the star button now." 

Using an automated phone system is almost like playing a video game in 
which you try to maneuver your way successfully through a maze until you reach 
a certain place where you can finally get what you want. A person's usual re- 
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sponse at this point is, "Why wasn't that the first thing the computer asked me so 
I didn't have to go through five menus to get to a person on the telephone?" One 
of the most frustrating things is to get to that final menu where you think you'll 
get your information and the voice tells you that you have to call back during 
regular business hours to get that information! 

I could go on and on about poorly-designed products and user interfaces. 
Fortunately, there are some well-designed product user interfaces to look at. One 
of the most familiar examples of a well-designed user interface is the automobile. 
The user interface for the driver of an automobile is the dashboard, the controls, 
and the pedals used to drive the car. The automobile is a very complicated piece 
of equipment, and early models of cars (and computers!) required too much skill 
to get started and to drive. Yet it takes very little skill to use automobiles today. 
Unfortunately, we can't say the same for computers. The mechanics of how the 
automobile engine works and most everything that goes on under the hood is 
fairly well hidden from the driver. 

Almost everything (especially mechanical and electrical items) that is im¬ 
portant to the driver or that can go wrong with a car is made visible in some form 
within the driver's eyesight. Even though dashboard styles and controls vary 
greatly among automobiles, the car really is one of the best examples of standard 
interface design and usability built into a complex product. We all feel comfort¬ 
able getting into a car we've never been in before. We can find the ignition, the 
lights, the seat belts, the speedometer and we can drive the car without any addi¬ 
tional knowledge or experience. I've sometimes found myself driving a rental car 
without even knowing the brand and model of the car! I could drive the car 
without needing to know this information. 

However, as I discussed earlier with the safety features on new cars, your 
confidence about your ability to use a car can backfire on you. When something 
doesn't work in an interface you think you know very well, you get even more 
confused and frustrated. You then either blame the car for having a nonstandard 
interface or blame yourself for not being able to figure out how to start the car or 
turn on the lights! This is just standard human behavior in situations like this, 
where bad things happen to good people who think they know what they're do¬ 
ing. 


Today's graphical user interfaces and object-oriented user in¬ 
terfaces are very different from the user interfaces you may currently be used to. 
While they are touted for their ease-of-use, there is a major learning effort re¬ 
quired for you to move upward in the evolutionary software user interface chain. 
There is also a major increase in the programming skills needed to effectively 
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build the user-friendly programs that users demand today. GUIs and OOUIs may 
be popular for the usability issues I'll discuss, but they are more of a problem for 
traditional developers. The process of designing and creating graphical and 
object-oriented user interfaces and programs requires a much steeper learning 
curve and also requires some amount of training to embrace the different pro¬ 
gramming and user interface environment. These shifts in programming and 
user interface styles and techniques will be discussed. 

The type of computer interface you choose will also determine where you 
are asking the computer hardware and software to use its processing power. In 
the past, when user interfaces were not as sophisticated as today's systems, com¬ 
puting power was used mainly to perform software functions as quickly as pos¬ 
sible. Today's powerful computers are using most of their processing power to 
make the programs you run easier to use at the software interface. 

Bud Tribble, Vice President of Software Engineering for NeXT Inc. says, "On 
the desktop today, 80 percent of computing power is going toward ease-of-use, 
such as menus, windows, and pop-ups. Only 20 percent is actually going to¬ 
wards doing the job, such as calculating your spreadsheet." (Seymour, 1992b). 
However, this is not a bad thing, as most of you appreciate these efforts to make 
computers easier to use. Tribble continues, "The one thing worth devoting com¬ 
puter power to is the interface. But there's a paradox: The simpler the interface, 
the more CPU cycles you use up. Interfaces are all about fostering 'appropriate 
illusions,' and the more realistic the illusion, the more demanding it is in terms of 
power." Our hope for the future of computing is that the power of computer 
hardware keeps growing at its current tremendous rate so that the power can be 
used to make computer software easier to learn and easier to use for us in the 
years ahead. 


My Mother Wants to Know: Windows or OS/2? 


"Instead of 'What are the better points of OS/2 vs. Windows?’ it 
turned into 'My operating system can beat up your operating system.' 

Steven Stern, 1992 
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I've defined what user interfaces are, but I haven't yet defined what is meant by 
an operating system. The operating system is the software that controls the use of a 
computer system's hardware and software resources. The hardioare resources in¬ 
clude the physical storage (internal disk space and external storage such as dis¬ 
kettes) in or attached to the computer, the computer's processor and memory, input 
devices (such as the keyboard, mouse, joystick, trackball, and touch screen), and 
output devices (such as the display, printers, and plotter). The hardware also in¬ 
cludes other devices that can be connected to a computer such as multimedia 
systems using speakers, laserdisc players, and CD-ROM devices. The type of 
hardware, processing power, and the amount of installed memory is critical to 
you as a user and developer, because they determine the type of operating system 
that is able to work on your computer. 

An operating system is also the base software platform on which your soft¬ 
ware programs will run. It provides a protective software layer between your 
programs and the computer system so that the products don't have to work di¬ 
rectly with the computer's hardware system. This definition applies to all of the 
operating systems I'll be discussing, from lowly DOS to the Windows graphical 
environment and the OS/2 operating system. One of the differences between 
operating systems is the range of computer hardware they can control and the 
amount of system control you and your programs have. 

The type of operating system you run on your computer will determine 
what the programs you use will look like and what they can do. It will determine 
how you can look at and manipulate your information (text, graphics, images, 
video, and so on). Operating systems also determine what other technologies you 
are capable of using with your computer. Today's operating systems allow com¬ 
puters to network together to share programs and data, allow computer users to 
communicate electronically and send data, and provide support for multimedia 
computing (which I'll get into later in detail). 

The operating system also provides an interface, or shell, to access the sys¬ 
tem hardware and software. Finally, the operating system determines the base 
user interface capabilities of the programs you'll use in your everyday work. Ad¬ 
ditional hardware and software utilities such as data storage compression, hard 
disk optimization, and anti-virus software programs are also now being incorpo¬ 
rated into the base operating systems. 

While there are many functional differences between Windows and OS/2, 
one of the most critical is the user interface for the two operating systems. I'll be 
discussing these user interfaces in much greater detail and comparing these two 
software environments. 
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Numbers, Numbers, Who's Got the Numbers? 


Have you seen the computer magazines lately? There is very definitely a war go¬ 
ing on over who has developed the best and most popular graphically-oriented 
personal computer-based operating system. Depending on who you listen to 
(and when), the casualty count and battle statistics are very different. Skirmishes 
between IBM and Microsoft have been going on for a number of years. These 
battles have escalated into a full-scale war since 1990 with the introduction of the 
graphically-oriented user interfaces of Windows 3.0 and OS/2 1.3. OS/2 was ini¬ 
tially jointly designed and developed by IBM and Microsoft. The original strat¬ 
egy was that Microsoft's Windows was a migration step along the way to OS/2. 
This strategy was mutually promoted by both companies. However, with the 
tremendous success of Windows 3.0, Microsoft jumped off the OS/2 bandwagon 
and changed their strategy to promote Windows instead of OS/2. 

1992 was a big year in the operating system war, with IBM shipping OS/2 
2.0 in March and Microsoft shipping Windows 3.1 in April. IBM's OS/2 has a 
long way to go to begin to catch up to the installed base of Windows users. Sales 
of OS/2 2.0 quickly reached the 1 million mark by August and even 2 million 
copies (depending on the information source) were shipped by the end of 1992. 
Windows 3.1 was estimated to be selling 1 million copies a month at the same 
time. Although OS/2's numbers are smaller than Windows 3.1 sales, OS/2 2.0's 
initial sales figures are higher than initial sales of Windows 3.0 in its first months. 

Do you wonder why there is such a war going on over operating systems 
and user interfaces? Well, it really is simple. Take a look where the revenue and 
growth is in the computer market today. A 1992 Dataquest study (as reported in 
Wall Street Journal, January 29, 1993) showed that personal computer software rev¬ 
enues increased 30% from 1991 to 1992. This very healthy increase took place 
while the overall computer hardware revenue declined. The only positive growth 
in hardware revenue was for workstations (a 3.9% increase) and for personal 
computer hardware, whose growth was also only in single digits, with an in¬ 
crease of 7.2%. It doesn't take a long time to figure out that there is much higher 
growth opportunity in computer software than in the hardware. A popular joke 
in the computer industry is that hardware prices are getting so low the manufac¬ 
turers are just about giving the hardware away so they can sell customers the 
software needed to run the hardware! 
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To Migrate or Not To Migrate, That Is the DOS Question 

"We are finding costly and complex ways to do 
what was once simple and inexpensive." 

Robert Samuelson, 1992 


As you well know, there is still a huge installed base of personal computers run¬ 
ning the DOS operating system. DOS was originally developed in 1981 and has 
been around for over ten years. With all of the excitement over the GUI-OOUI 
war between Windows and OS/2, it's easy to forget about DOS users. However, 
they still account for around 80% of all personal computer users. One rough es¬ 
timate is that there are over 60 million DOS systems in use, while others claim this 
figure could be over 100 million. Windows has shipped nearly 20 million copies 
since version 3.0, and OS/2 2.0 shipped somewhere around 2 mill i on at year-end 
1992. 

The numbers differ when you listen to the various sources and when you 
look at shipped volumes versus what is actually installed and used. Most Win¬ 
dows shipments were bundled with PC hardware, even to those computer users 
who had no use for it or didn't want it. Even Microsoft’s internal estimates show 
that only about one-third of the Windows software sold is actually in use. This 
puts the Windows user base at somewhere around 6 million. Of OS/2's 2 million 
shipments, it is estimated that somewhere around 1.5 million are actually being 
used. 

As you can see, with all the DOS users who use neither Windows nor OS/2, 
it is still much too early to declare any clear winner in the GUI-OOUI war. Neither 
one can really be called the corporate standard in the industry at this time. Re¬ 
gardless of the numbers, the phenomenal growth of both Windows and OS/2 
over the past two years has escalated the migration of the major program devel¬ 
opment efforts to these operating systems, and as the major developers go, so 
goes the rest of the development world. 

Personal computer research statistics for the United States marketplace 
(InfoCorp, January, 1993) show some interesting results on the average number of 
programs per system from 1991 through 1993. DOS systems leveled off at a peak 
of about 5 programs per system, while GUI systems (combining Windows, 
Macintosh, and OS/2) rose from 6.7 in 1991 to 7.5 in 1992 and are estimated to 
reach 8 programs per system in 1993. 

Corporate and individual users usually shy away from migrating their sys¬ 
tems to a new operating system until they feel that there are enough major pro- 
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Figure 1-8. The DOS Migration Dilemma 


grams on that base to justify their move to that operating system. This is the 
main reason why computer users were somewhat hesitant to move to OS/2 2.0 in 
1992. At that time, there were few major programs developed to exploit the 
technical capabilities of OS/2, but that corner was being turned at the end of 1992 
and early in 1993, when IBM reported that over 1,000 programs specifically de¬ 
veloped for the OS/2 2.0 operating system were commercially available. 

Another major step was taken on January 18, 1993 when WordPerfect Cor¬ 
poration announced the development of WordPerfect® 5.2 for OS/2. This is the 
first graphical version of WordPerfect for OS/2. By the way, WordPerfect is the 
world's bestselling word processing software product. The product will be com¬ 
patible with WordPerfect 5.1 for DOS and WordPerfect 5.2 for Windows. The 
company is also developing a new version, WordPerfect 6.0 for OS/2, which will 
fully take advantage of OS/2's 32-bit, multi-threaded, and Workplace Shell capa¬ 
bilities. This kind of news will help boost the acceptance of OS/2. 
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Another reason for users to migrate to the newer, more powerful operating 
systems is to upgrade the key programs they use. Until recently, most developers 
kept upgrading their DOS-based products as they introduced newer versions for 
the Macintosh, Windows, and OS/2 platforms. DOS users could still keep 
somewhat technologically current with their DOS upgrades. But that trend will 
slow down in 1993. Users will find more often that the older DOS versions of 
their products are not going to be upgraded. This will leave the lower end of the 
DOS platform technologically stranded in the 1992-93 time frame. 

In January, 1993, Lotus Development Corporation announced that it will not 
be upgrading its Lotus 1-2-3® version 2.x DOS spreadsheet product. The next 
major upgrade to the DOS 1-2-3 product line will be 1-2-3 version 4.0. It will re¬ 
quire at least 2 megabytes of computer memory, which is more memory than 
most older computers have installed. Version 2.x users will be offered only 
maintenance updates, which will provide access to drivers for new printers and 
other peripherals. The combination of lower-cost, more powerful hardware and 
the popularity of the GUI operating systems will lead more software product de¬ 
velopers to these same conclusions for their older DOS products. 

In the never-ending search to improve business success and user productiv¬ 
ity, more companies, both large (including most of the Fortune 500) and small in 
size, are migrating to client/server networked hardware and software environ¬ 
ments and away from the mainframe (large systems) environment. Client/server 
systems are those where separate systems work together over a network to pro¬ 
vide computer services. The server is usually a large system that provides ser¬ 
vices to its clients. The client systems get their services and information from the 
server and provide an interface to the user. Client systems may be workstations, 
desktop computers, personal computers, mobile communications devices, and 
even your own automobile and television. 

Many companies are planning to replace their older personal computers 
with new powerful personal desktop and notebook computers that can run 
graphical user interfaces. Most of these companies are now trying to make in¬ 
formed business decisions whether to use Windows 3.1, Windows NT, or OS/2 
2.1 as the base operating system for their company. 

The 1992 Dataquest study showed that while overall computer revenue de¬ 
clined, PC revenue grew from $43.4 billion to $46.5 billion from 1991 to 1992, an 
increase of 7.2%. While mainframe revenues declined 15.5%, however, they still 
remain greater than 20% of the entire computer systems market. This shows that 
although the mainframe market isn't dead yet, it is slowly eroding in favor of 
workstations and client/server computing environments. 
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Figure 1 -9. The Client/Server Environment 


Think First, Buy a Computer Later 

Be careful not to get too excited by the computer advertising and run out and buy 
the latest and greatest computer you can (or can't) afford. Please remember that a 
computer is just a tool to help you do your tasks that you don't want to do some 
other way. My main purpose is to help you understand that computers should 
help you do your work or even possibly just amuse you. Don't fall into the trap 
of purchasing a computer first (possibly in a fit of technology envy) and then try¬ 
ing to figure out what you want to do with it! Many computers turn into expen¬ 
sive desktop furniture that is seldom used. 

One of the reasons why no real "home computer" has yet been developed is 
that we can't really figure out how to get a computer to help with all the things 
you do around your home. There are numerous software products developed to 
help with tasks in the home such as handling personal finances. Recording my 
checks and balancing my checkbook are not my most pleasant household activi- 
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ties. Unfortunately, the ability to do these tasks on a computer doesn't interest 
me. I'm just not interested in spending my time learning how to balance my 
checkbook with a software program. 

What all this means is that you might be perfectly happy with whatever 
computer system and software you are currently using. Don't fall prey to the 
computer advertising campaigns and purchase more of a computer system than 
you really need or want. If you haven't yet purchased a computer, take your time. 
Remember, computers get more powerful and sophisticated the longer you wait. 
They are also one of the few items you'll ever purchase that are getting cheaper 
and cheaper at the same time. One of the most important things I'll talk about is 
how to determine if computer products really do offer you easy-to-install, easy- 
to-learn, and easy-to-use ways for you to do your work. 

The next chapter will take you into the area of the psychology of the 
human-computer relationship. You'll get to see just how good an amateur psy¬ 
chologist you really are! 
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The Psychology of 
Humans and Computers 


"The way a user interacts with a 
computer is as important as the 
computation itself; in other words, 
the human interface, as it has come 
to be called, is as fundamental to 
computing as any processor 
configuration, operating system, 
or programming environment." 


John Anderson, 1989 



Which Type of Computer User Are You? 
What Kind of Human Being Are You? 


"Are you a good witch-or a bad witch? " 

Glinda (The Good Witch) to Dorothy in "The Wizard of OZ" 


Before you read about all the perceptual and psychological aspects of using 
computers I'll be discussing later in this chapter, there are some other user beliefs 
that are very emotional, possibly psychological, and almost religious in the fervor 
with which they are held. It may seem silly, but the feeling of "us vs. them" in the 
evolution of computers is serious stuff, both at the personal level and the corpo¬ 
rate level, and the history of this energetic debate is worth discussing. 

Many, if not most, computer users have certain beliefs about the computer 
hardware they use and the operating system and user interface they prefer. They 
truly believe that their choice of computer systems determines just what kind of 
human being they are and how they fit in the scheme of things in the cosmic 
universe! An article in the "Technoculture" section of Esquire magazine by Donald 
Katz (1990) asks, "So, Whose Side Are You On?" 

The technoculture wars began in 1984 after Apple first produced the 
Macintosh computer. IBM computers had already been available for a few years. 
At first, it was a hardware debate between Mac users and IBM computer users. 
Katz notes, "First-time computer purchasers often felt they had to decide who 
they really were in order to own a computer, because the difference between a 
Mac person and an IBM person implied an entire life-style, attendant cultural 
proclivities, and which district of your brain you used." 

Mac people were "West Coast." In their own words, "They were enlightened, 
hip, post-modern, right-brained, well-adjusted, and generally appreciative of art, 
aesthetics, and the interpersonal relationships that the simplicity of the Mac gave 
you time to enjoy." PC people, on the other hand, were "East Coast, left-brained, 
serious techies, hackers, elite power users, wealthy number crunchers, writers, 
and in general, more successful." 

It’s almost like the personality values we attribute to the car we drive. The 
old adages, "You’re only as good as the car you drive," or "You are what you 
drive" is indicative of how we equate the things we own and use with who we are 


32 


The GUI-OOUI War: Windows vs. OS/2 





Figure 2-1 . The TechnoCulture Dilemma 


or who we want people to think we are. In fact, the article quotes an Apple ex¬ 
ecutive saying "PC people drive Buicks." But on the other hand, a PC person is 
quoted as saying, "Apple executives are people who grew up on Star Trek, at¬ 
tended EST, and always wanted, more than anything else in life, to drive around 
in BMWs." So, who really is more successful? 

The PC vs. Mac hardware feud grew into a software debate between the 
graphical user interface (GUI) and the DOS character-based user interface (CUI) 
as the PC hardware clones expanded from the IBM base of PCs. An academic ar¬ 
ticle written by a college teacher (Halio, 1990) showed the existence of this debate 
and also showed its intensity, as her article sparked a whole series of skirmishes 
that broke out on the literary front. Her observations were that students who 
wrote research papers on Macs with GUI word processing software wrote worse 
papers than students who wrote papers using PCs with standard character-based 
word processing software. Note that these were observations from her academic 
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experiences; it was not a controlled scientific study. I'll talk much more about 
GUIs and GUIs and get into the real story behind these interface types later. 

Here it is interesting to see that the technoculture differences I am discussing 
were observed, not only in the minds of college students, but in their work prod¬ 
ucts'. Students got to choose which computer lab section of freshman composition 
courses they wanted: Mac or PC. Halio found that "Mac students chose to write 
about such topics as fast food, dating, bars, television, rock music, sports, rela¬ 
tionships, and phenomena such as the foam 'popcorn' chips that come in so many 
packages." This was very different from the work of the PC students, who wrote 
"...essays on capital punishment, teenage pregnancy, nuclear war, and drunk 
driving..." Students themselves had very different views about the computers 
they used, saying they tended to think of the Mac as a sort of toy. They even gave 
the printers in the lab cute names! However, students in the PC lab were not so 
lighthearted. They thought of their time with the computers as worktime rather 
than playtime. 

This all seems like humorous and mildly entertaining stuff, doesn't it? Well, 
it became very serious when magazines and newspapers like Business Week and 
the New York Times ran stories about the article, unfortunately treating the 
author's observations as if they were scientific fact. In a later article in 
MACWORLD , titled "Does the Mac Make You Stupid?", author Steven Levy (1990) 
discusses the debate and concludes, "The Mac itself doesn't hurt one's writing. 
Instead, if a teacher does not set specific limits, the Mac gives students the ability 
to express themselves in powerful new ways, some of which reflect the some¬ 
times slipshod, sometimes sneaky forms of persuasion that proliferate in our 
television- and advertising-soaked culture. Halio's ultimate complaint is that the 
Macintosh fast-lanes students into a pop-culture form of expression." 

Regardless of where your opinions lie in this debate, it is very interesting to 
see how serious the consequences of this kind of public discussion can be. To 
counter any negative impact from this series of events. Levy says, "Apple now 
distributes a shiny brochure detailing how the Mac enhances college composition 
courses, loaded with testimonials from professionals." 

As you can see, the mind-set of computer users and the perceived personali¬ 
ties of computers themselves is a real and serious concept that directly impacts 
how people purchase and use computers, and how users think of themselves. As 
Halio describes her surprise over the furor that erupted after her article, "People 
have an incredible emotional attachment to their computers." This goes way be¬ 
yond the old distinction made between computer novices and computer hackers 
or nerds. 
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In fact, this two-sided technoculture gap is growing as computer technology 
evolves, and today's operating system and user interface technology environment 
exemplifies this shift. The historical PC vs. Mac war of the 1980s became the CUI 
vs. GUI war, and now in the 1990s we have the GUI vs. OOUI war. I have the 
feeling that some of you are already actively developing the next level of this 
techno-cultural debate in your own "My technology is better than your technol¬ 
ogy!" discussions with your friends and co-workers. The candidates for the chal¬ 
lenger to the GUIs and OOUIs of today are most likely the MUIs (Multimedia 
User Interfaces) and VRUIs (Virtual Reality User Interfaces) of tomorrow. I'll dis¬ 
cuss these future technologies later. 


Techno-Typing Comes of Age 

"Whether a person likes technology or not, his or her economic survival 
depends on a basic knowledge (or at least an absence of fear) of computers." 

Jamie Ray Wright, 1993 


Just recently, the technoculture concept has come to the forefront of computer 
marketing with the release of a "techno-tolerance" study (Dell, 1993), conducted 
by Dell Computer Corporation, one of America's largest computer hardware 
suppliers. After surveying over 1,000 adults and 500 teens across the country, 
they found some very interesting results. Despite the technological age that many 
of us participate in, one-fourth of all U.S. adults have never used a computer, set a 
VCR to program a TV show, or even programmed favorite stations on a car radio, 
according to this study. 

Teens are more in tune with technology, showing higher degrees of comfort 
across the board with various technical devices. Figure 2-2 shows some of the 
statistical results of the study, comparing comfort levels of adults and teens. 

As a result, company Chairman Michael Dell says, "A key finding of our 
study is that people tend to fit into one of several broad categories based on how 
they use computers and relate to, or resist, learning about new technologies." To 
this end, Dell has developed a concept called Techno-typing , to better match 
people and computers. The goal of this effort, as Dell said, is "...to help people 
understand what computers can do specifically for them and how to go about 
finding their perfect PC match." Of course, Dell's ultimate goal is to sell more 
computer hardware. The techno-types identified by the study are described in 
Figure 2-3. 
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Figure 2-2. Technology Comfort Survey Results 


»1,11 if i iMWm xhL ese efforts are attempts to break through the technology 
and interface barriers between people and the computers they need to use to do 
their job. The study's results show that lots of people can't handle today's techni¬ 
cal appliances and computers. A portion of the problem lies in the complexity of 
the technology itself. However, as you'll see here, much of the problem lies in the 
inability of products to provide interfaces that people can use and feel good about 
themselves and their ability to use the technology. 
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You Are an 


Techno-types 


Technology 
expert/hobbyist; 
wants it hot 
for not a lot. 


Techno-Boomer 

Wants to look smart; researches 
and seeks recommendations 
before making purchase decision. 


Techno-Teamer 

Corporate computer user; 
typically job and team-oriented; 
seeks reliability. 


Techno-Phobe 

Techno-way. 


Source: Dell Techknowledge in America Survey, Dell Computer Corp. 


Figure 2-3. Dell's Technology Types Definitions 


" Luckily, there are now program design teams who realize that the 
human is a vital component in the interactive system-a component 
whose complexities should be treated with at least as much respect as 
those of a laser printer. What causes the human not to be able to play 
his or her role is no more or less than clumsy program design." 
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Just as you must have the correct cable with the right connections to hook up a 
printer to your computer, the software interface must be designed to match your 
needs and wants as a user with the capabilities of the computer. Who does this 
work in designing and developing a computer software product? And more im¬ 
portantly, how well do they do it? This section will look at the psychological 
makeup of the critical human elements in interface design and development. 


Different Strokes for Different Folks 

Why is the user interface so important to users, designers, and developers of 
software products? Because that is where the user interaction is! As I've dis¬ 
cussed briefly, there are different views of computers, depending on their role in 
computer design, development, and use. Inconsistency among programmers'. 



Figure 2-4. Human-Computer Connections 
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designers', and users' experiences, viewpoints, and skills with a system, its func¬ 
tions, and tasks, causes many problems in our lives, even without looking at 
computer systems. Most books and guidelines on user interface design talk about 
these viewpoints as different models of a user interface. Before I define these 
models, let's first look at an example you'll find familiar. 

The people involved in building a custom home have very different per¬ 
spectives on the same set of objects. A house that is designed and built has at 
least three viewpoints: the architect's, the builder's, and the homeowner's. Each 
of these people has a very different viewpoint of the same project. Who they are 
and their role in the house-building project determine the tasks they perform, the 
goals they desire, the skills they bring to the project, the tools they use, and how 
they interact with each other. This goes back to the experiences and expectations I 
discussed in Chapter 1. 

The architect studies the life-style of the homeowners, their family, and their 
functional and aesthetic desires for the house. He or she turns all that into the 
visualization and, ultimately, the design of a house that can be built to meet the 
homeowners' desires and needs within their budget. The architect acts as the 
homeowners' representative in designing the plans and specifications and ensur¬ 
ing that the builder follows them. 

The builder has the skills and resources to work within the confines of the 
designs and specifications of the architect to build a house that the homeowners 
will be pleased with and can live in. These skills include knowing the appropriate 
materials to use and all of the regulations and codes for building an environmen¬ 
tally and functionally sound structure. 

The homeowners will ultimately be the owners and occupants of the final 
product and are the most important people in this whole project. They're the ones 
who are paying for the house and have to live in it after it is built. Any 
homeowner who has had a home designed and built for them knows how com¬ 
plicated and difficult the process of building a house can be. Although we love 
our beautiful home, my house-building experience with our particular builder 
was not a very pleasant experience. Edie (my wife) actually wouldn't marry me 
until we had finished building the house. As she truthfully put it, "If we can 
survive building a house together, then I feel we can survive a marriage!" I'm 
happy to say that we did survive building the house and have been happily mar¬ 
ried for over six years now. 

The point that I'm trying to make here is that any project such as building a 
house or developing a computer product involves individuals and groups working 
together to build something that everyone is trying to make into a successful 
product. The architect is the product and user interface designer. The builder is 
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the programmer, and the homeowner is the user of the finished product. I'll now 
discuss how these different groups of people must interact and work together to 
build a usable product. 


User Goals: What are They? 

Why do people use computers or devices that are computerized? Because they 
want to complete a task or reach some goal that is more easily and accurately ob¬ 
tained by the use of a computer. Since the computer is really an aid in reaching 
our goals and performing our tasks, then why do we put up with poor product 
design? Often we don't have much choice. 

You probably haven't thought about it much, but do you know what your 
goals are as a computer user? How about users of programs that you design and 
develop? Do you understand their goals? User goals might include increased 
productivity, greater accuracy, higher satisfaction, and more enjoyment with a 
computer. Children assign a very different priority to their goals when using a 
computer-fun is definitely at the top of the list! 

Today's young computer users will be the corporate computer users of the 
future. They have grown up very differently from the way we grew up with 
technology and computers. Elliot Soloway, in "How the Nintendo Generation 
Learns" (1991), discusses the differences that will come about in the computer 
industry and educational institutions as a result of the way today's children have 
grown up with computer technology, entertainment, and television. 

Since we have different goals depending on who we are and what we're do¬ 
ing, you'd expect the software we use to be different. Entertainment software is 
focused on having fun and being "user seductive." The system might be a 
Nintendo game for a child or a video slot machine for an adult. If the designer's 
goal is to entertain you and keep you putting money in the machine, then the in¬ 
terface must entice you and make it as easy as possible for you to use the ma¬ 
chine. 

You probably don't think of fun as a goal when you use the computer for 
personal productivity or work. In fact, if you're trying to get work done, you 
want something that is more concerned with ease-of-learning and ease-of-use 
rather than fun-to-use. However, all serious software designers and program¬ 
mers can learn from the software and interfaces that are geared toward education 
and entertainment. 
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People and the Obstacles that Are Put in Their Way 

You know how anxious automobile drivers (but not you, of course!) get at a rail¬ 
road crossing when the train doesn't come after a period of time? Drivers creep 
out to see if there really is a train coming and then go around the crossing gate 
and cross the railroad tracks. The interesting question is, how long do drivers 
wait before they become too impatient to wait for the train to come? This is a 
question for psychologists and researchers. Railroad engineers have found that 
the crossing gates should come down only 20-30 seconds before the train ap¬ 
proaches the railroad crossing. If the gates are brought down earlier than this, 
drivers tend to get anxious and go around the gates. If the gates don't come 
down at least 20-30 seconds before the train arrives, there isn't enough time for 
drivers to be sufficiently warned about the train, which may be travelling at a 
speed of about 50-60 miles an hour. 

This highlights an important lesson for software user interface 
designers. Understand who your users are, where they are trying to go, and fig¬ 
ure out how much misdirection and frustration they can stand before they give 
up and do something else. 


Is There an Optimal Program or User Interface for You? 


"A computer will do what you tell it to do, but that may 
be much different from what you had in mind." 

Joseph Weizenbaum, 1978 


In the early stages of writing this book, I did my work using a very simple 
character-based text editor. This work included my proposal to the publisher, my 
rough content outline, the more detailed chapter topics, and most of the text for 
the first few chapters. Why did I choose this type of program? Because, at that 
time, I was only interested in getting my thoughts and ideas written down as fast 
and as easily as I possibly could. Was it a sophisticated program and interface? 
That is, did it have a visually-oriented, graphical user interface? No, but it was 
the best type of interface to help me reach, the goal I had at that time, which was just 
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to put words on the screen. Did I continue to write the rest of the book using this 
simple text editor? No, because it wasn't the best tool or program to help me 
reach my new goal, which had now grown to writing the rest of the book. This 
included creating and importing the one hundred or so graphics I wanted to use 
as illustrations and examples. 

I also had to format the book according to the publisher's standard page 
layout, type styles, font sizes, and other aspects of a book that are necessary to get 
it ready for publication. My simple text editor was no longer a tool that could 
provide the functional capability or the interface for the tasks I was now required 
to do to finish the book. 

After some research and discussions with colleagues, I began using a word 
processing program (DeScribe® 4.0 for OS/2 2.0) that had the functional capa¬ 
bilities I needed and a user interface that allowed me to do sophisticated word 
processing and publishing tasks very easily. It had a very well-designed graphi¬ 
cal user interface that let me do what I wanted to do very quickly and easily. I 
had never used this particular word processing program before, so I first started 
by learning how to use the interface to figure out what the program could and 
couldn't do with regard to writing and publishing a book. 

As I began to use the program, I must admit I did fall prey to the seductive¬ 
ness of playing around with my new toy and I did spend a lot of time trying out 
different type styles and fonts, page layouts, and other visual effects, rather than 
writing the book content itself. After all, this program has a WYSIWYG interface 
(What You See Is What You Get), so I could see exactly how the page would look 
when it was printed! This is exactly what students did with their research papers 
in the Halio article I discussed earlier. It was much easier, and more fun, to play 
with what the book was going to look like rather than writing the words themselves. 
I found myself thinking, "Hmm, should I center the chapter title on the page, or 
should I move it flush left or flush right? Should the chapter section titles be in all 
capitals or not?" This was easier than thinking, "What am I really trying to say in 
this section about users and their programs?" Ultimately, I had to complete both 
tasks, but it was easier to procrastinate and do the tasks that are visual and more 
fun than the tasks that are more work. This is just human nature, I'm afraid to 
say. As a cognitive psychologist, I realize this, but that doesn't mean I can change 
my behavior any easier than you can! 


KEY IDEA! 


■—_———— My experiences writing this book emphasize the point I'm 
making here. There will never be only one perfect tool, program, or interface for you as a com¬ 
puter user, since you are constantly changing your goals according to the tasks you 
are trying to accomplish at any particular time. A very simple text editor is no 
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match for a GUI word processor on a functional or interface scale, but each can be 
the optimal program for the task you happen to be doing at that time. In fact, the 
more sophisticated program actually got in the way and distracted me from my 
first writing goal. It allowed me the opportunity to pay more attention to the 
"pretty stuff", the visual presentation of the information I was working with, 
rather than the actual task I should have been doing. I should have been writing 
words, lots of words, very interesting words, too, I hope. 

So you see, there is some truth to the "reverse psychology" effects we saw with 
the college students' report writing escapades. If you don't want people to focus 
on the visual and graphic aspects of a particular task, then don't give them tools 
that easily allow them to focus on these aspects. If the only goal for the students 
in their writing course was solely the content of their writing, then what is the 
benefit of letting them use a graphical word processing program? It's like giving 
a child a whole box of 128 crayons and a coloring book and leaving them alone. 
Then an hour later you come back and tell the child, "I'm sorry, but you were 
supposed to use just one color crayon and you were supposed to draw inside the 
lines." 

Users not only need different user interfaces and programs for different 
tasks, but your level of expertise can change even ivithin a task while using one 
program. For example, you may use a spreadsheet program for your work and 
may be quite an expert on the spreadsheet functions and actions that you use all 
the time. For speed and efficiency, there may be certain keystrokes or "macros" 
that you have memorized and can perform without even thinking about them. 
However, there may be parts of the task that you do less frequently and you can 
never quite remember exactly how the commands must be typed, or exactly 
where in the menus are the choices you need. This is where you need a little 
support from the program and the interface to help you remember how to do the 
infrequent portions of your task. Later on. I'll discuss the topic of which interface 
style is appropriate for you at different times, depending on whether you are a 
novice user, casual user, or very experienced at whatever you are trying to do. 


Models and Metaphors: Transferring World Knowledge 

The different roles and viewpoints I've described form the models of a user inter¬ 
face: the user's model, the programmer's model, and the designer's model. These 
models and their importance are well-described in the IBM Common User Access 
(CUA) Guidelines (1992) and are pictured in Figure 2-5. First, let’s step back and 
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Figure 2-5. User Interface Models, from IBM (1992) 


look at what a model really is. A model contains the concepts and expectations a 
person develops through experience. Sound familiar? This is just a formal defi¬ 
nition of a user's experiences and expectations in the world around them that I 
discussed in Chapter 1. 

A mental model is an internal representation of how a user understands and 
interacts with a system. We're often not aware of our mental models, and "A 
mental model does not necessarily reflect a situation and its components accu¬ 
rately. Still a mental model helps people predict what will happen next in a given 
situation, and it serves as a framework for analysis, understanding, and 
decision-making." (IBM, 1992). People form mental models for a number of rea¬ 
sons. Mayhew (1992) lists why people form mental models: 

1. Models enable users to predict future (or infer invisible) events. 

2. Models allow users to find causes for observed events. 

3. Models allow users to determine appropriate actions to cause desired 
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changes. 

4. Models serve as mnemonic devices for remembering relations and 
events. 

5. Models are a means of understanding an analogous device. 

6. Models allow people to use strategies to overcome information pro¬ 
cessing limitations. 

The mental models I will discuss underlie all of the interaction between us¬ 
ers and their computers and thus are the basis for the user interface principles and 
guidelines I'll discuss in the next chapters. Why is it so important to discuss these 
models? Mayhew sums it up well; "Users always have mental models and will 
always develop and modify them, regardless of the particular design of a system. 
Our goal as user interface designers is to design so as to facilitate the process of de¬ 
veloping an effective mental model." 

Transferring our knowledge of the world around us to the world of com¬ 
puters uses these models to guide our interactions with computers. The idea of 
the "desktop metaphor" behind many of the various GUI and OOUI user inter¬ 
faces is built on the foundation that users know their way around an office and 
are familiar enough with the office environment and the idea of a desktop as a 
working space. Designers use this metaphor to map the way users do things on 
the computer to the way users would do them if they weren't using the computer. 


The User's Conceptual Model 


The reason for discussing models, and in particular the user's conceptual model, 
is that software products must be designed to fit in with the way users view the 
computer system they are working with. Since this is all inside people's heads, it 
isn't easy to get to and figure out. 

The benefits of using computers and graphical user interfaces are many if 
products are well-designed. GUIs can educate and entertain as well as allow us¬ 
ers to do their work. Look at the interface in Figure 2-6. This is a product called 
The Playroom™, by Broderbund Software, Inc. Obviously a child's program, the 
award-winning product advertises, "Welcome to The Playroom. Where children 
learn to love learning." This is a graphical user interface that allows children to 
learn valuable skills such as reading, spelling, arithmetic, and creativity, using 
letters, numbers, and times. Children also learn to use a computer interface and a 
mouse. 
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Figure 2-6. The User's Conceptual Model in the Playroom 


The product uses the metaphor of a playroom in your child’s home. Talk 
about designing a product to match your user's conceptual model! The interface 
is full of objects, playmates, and activities. Some of the objects lead to other 
screens where children play a learning game or activity. To return to the Play¬ 
room, there is an icon of a little door in the lower right corner of the screen. This is 
a simple, effective way to use a child's knowledge of rooms in a house to allow 
him or her to navigate through the program. 

There are some differences between children’s and adult's models. Adults 
won't explore an interface as readily as children. In this program, there are ob¬ 
jects and activities that are not obvious to users, so they are encouraged to explore 
and click on anything in the interface. For example, if you click on the curtains in 
the window, the curtains will close and Pepper mouse will change into a fire¬ 
breathing dragon when the curtains reopen! This approach may not work with 
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adults. Adults would be more concerned about how they tell what does what in 
the interface? To children this would not be a concern, as exploring the Playroom 
and finding new surprises is all part of the fun of the product. 

Poor product and user interface designs lead users to doubt their interaction 
strategies and often lead users to develop strange and superstitious behaviors to 
account for illogical and inconsistent system design. Here's a personal example of 
how a bad experience with computers impacts user behavior in the future. The 
task I was trying to perform was a simple one, but the system responses led me to 
establish some "superstitious" behaviors when I do this task now. 

I was working on a mainframe computer and wanted to discard one file 
from a list of files. I know the command name I always use on this system is dis¬ 
card. However, when I typed discard, the system rejected the command and 
gave me an error message, saying "unknown command." I know that the discard 
command is correct, yet sometimes the system gets fouled up and doesn't recog¬ 
nize it as a valid command. I don’t know why or when this happens, but it does 
happen once in a while. I know that another command, erase, does the same ac¬ 
tion. (That's another whole discussion: why are there two different commands if 
they both do the exact same action?) So I typed erase, the file was deleted, but I 
received a confirmation message, "File discarded or renamed." Imagine my frus¬ 
tration! Never mind that the confirmation message was obviously serving a dual 
purpose to be used for both discarding and renaming files. 



Figure 2 - 7 . Superstitious User Behaviors 
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What was so bothersome about this episode was that if the file was discarded 
correctly, then why didn't the system let me use the correct command, discard in 
the first place? When this happens, my internal model of how the system works 
tells me that the computer is a little confused and my superstitious behavior is 
that I restart the computer and it doesn't happen again! I don’t know why or how 
it happens, but I do know that restarting the system seems to cure it. 

This incident is minor and did not cause any harm to me or my data. I'm 
sure you can think of many similar situations you've had with the various com¬ 
puter programs you use regularly. What these incidents tell us is that system de¬ 
signers and programmers didn't spend the time to understand how users think 
and try to use their products. 

How do you find out about the user's model, since it's inside someone's 
head? Because a user's conceptual model is based on a person's experiences and 
expectations, the only way to assess and understand the user is to talk with him 
and watch him work. CUA recommends five ways to gather information from 
users. I'll cover some of these areas in more detail later. The techniques include: 

1. Analysis of user tasks 

2. Surveys and interviews of actual or potential users 

3. Visits to user work sites 

4. Feedback from users 

5. Usability testing 

iiiiiiyn A key point to remember-be sure to get your feedback and 
input from users themselves , not their managers or a company executive. Why? 
You want to get your information from the people who will be using the product 
themselves, rather than someone who will be managing users or someone who 
really has only a limited view of what users really do. You will get very different 
input and feedback from the people who make purchasing or management deci¬ 
sions concerning software than from the people who will actually be using the 
products to make their living. For numerous reasons, it is difficult to get reliable 
feedback from users, but at least you'll be talking with the right audience. 

You must also be very careful about what you do with the information you 
get from users. They aren't system designers and often aren't aware of the tech¬ 
nology involved in computer hardware and software (that is your job if you're a 
designer). Users tend to rely on their memory of how they think they do their 
work, rather than actually how they do it. Therefore, it is important to also watch 
them as well as listen to them. Users will be telling you their own personal views 
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and preferences on the product you're designing or evaluating. Gather feedback 
from a large enough sample of users so that you can determine common sugges¬ 
tions and problems that run throughout their feedback. You don't want to evalu¬ 
ate or design a system based only on a few users' personal preferences and habits. 
Remember, there is no such thing as an "average" user. While users may share 
some common experiences and feelings, you are collecting feedback from a group 
of loosely grouped individuals. 


The Programmer's Model 


"This would be a great job if it weren't for all those damn users. 

Ed Kennedy (Programmer), 1975 


The programmer's model is the easiest to visualize because it is explicit and can 
be more formally defined. In fact, the programmer's model is most often seen in 
the form of the functional specifications for a software product. A programmer is 
a person who actually writes the code that makes up the system or program. 

The objects and data that make up the product are of interest to the pro¬ 
grammer, not necessarily the way the user will interact with the information. A 
programmer interfaces with a computer hardware system and, for example, 
stores and retrieves data as fields or records in a database of information. The 
user's view of that data should be quite different. The same data might be entries 
in a software checkbook program, information in a personal address book, or a 
business phone book. It should be obvious to the reader by now that a computer 
user has to be shielded from the programmer's view of the computer system and 
the system's representation of the user's data. 

The programmer's knowledge and expertise (see Figure 2-5) includes the 
development platform, operating system, development tools, and programming 
guidelines and specifications necessary to build software programs. However, 
these skills don't necessarily provide a programmer with the ability to provide 
users with the most appropriate user interface models and metaphors. 

The quotes from Gould (1988) show that many (though obviously not all) 
programmers are not really aware of the user's model of computer systems and 
programs (see Figure 2-8). In fact, some programmers do not appreciate the fact 
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Figure 2-8. Programmer's Comments on Software and Users, from Gould (1988) 


that their work must be usable by someone else. Don Burleson, in an editorial in 
COMPUTERWORLD, talks of a programmer friend who has a sign on his wall, 
"User is a four-letter word." Programmers have their own experiences and ex¬ 
pectations of how computers work and these experiences guide the way they 
build their products. 

Most programmers are more concerned with the function that the program 
provides to the user. For example, if 24 lines are available in a text window, many 
programmers might use most of those 24 lines regardless of whether the infor¬ 
mation will be readable to users. Whose job is it to look out for the user and en¬ 
sure that the program is usable? It's the user interface designer's role , so let's take 
a look at their model. 
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The Designer's Model 


"Most software is run by confused users acting on incorrect and 
incomplete information, doing things the designer never expected. ” 

Paul Heckel, 1984 


The main purpose of the user interface designer is to act like an architect, as I've 
described earlier in this chapter. Building a software product is like building a 
house. The designer (architect) takes the ideas, wishes, desires, and needs of the 
user (homeowner), merges that with the skills and materials available to the pro¬ 
grammer (builder), and designs a software product (house) that can be built and the 
user can enjoy. Figure 2-9 shows the designer's model as the intermediary be¬ 
tween the user's model and the programmer's model. It is very rare that pro¬ 
grammers ever actually meet the users of the products that they develop. Crazy, 
isn't it? But it's true! That void between the user's environment and the pro¬ 
grammer 's world is bridged by the user interface designer and others who work 
directly with product users. 

What exactly does a user interface designer do? Flow does the designer's 
model map the user's conceptual model to the programmer's model of the system 
and its capabilities? The designer's model describes the objects the user works 
with, their presentation to the user, and the interaction techniques used to manipu¬ 
late the user's objects. 

Figure 2-10 is commonly referred to as the "iceberg" chart. It is based on the 
early user interface work done by scientists at the Xerox Palo Alto Research Cen¬ 
ter (known as Xerox PARC). The chart is also attributed to David Liddle, the head 
of Metaphor Computer Company. IBM's CUA guidelines use the chart to discuss 
the importance of models in interface design. It shows that the interface 
designer's model is made up of three components. 

As you all may have experienced (but not analyzed as we are doing here), 
the look and feel of a product may catch your attention and your interest when 
you first see a product and try it out. As you use the product further, however, 
the look and feel good vibrations you may have felt at first will wear off if the in¬ 
terface doesn't work well with your objects and information. The interface must 
also fit with your model of how the system should work and fit the metaphors 
you are familiar with. The chart is depicted as an iceberg for a good reason. The 
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Figure 2-9. The Role of the Designer's Model, from IBM (1992) 


percentages associated with each of the three areas and their location in the ice¬ 
berg are very important. 

The tip of the iceberg is the ’’look" element. It’s the presentation of informa¬ 
tion to the user and it accounts for only about 10% of the substance of the 
designer's model. This part of the product interface is the use of color, animation, 
sound, shapes, graphics, text, and screen layout to present information to the user. 
Although it can be visually and otherwise stimulating, the presentation aspects of 
an interface aren't as important as the other areas. 

For example, the overuse of color in the interface can initially interest the 
user, but can detract from the task at hand when the product is used over time. 
We call this the "Las Vegas" color effect, for obvious reasons. Later in this chapter 
and in the chapter on user interface guidelines. I'll cover the appropriate use of 
color and other aspects of the presentation of information. Looking back on my 
discussion of college students writing reports using programs with graphical in¬ 
terfaces or text interfaces shows just how enticing the visual aspects of informa- 
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Object relationships 
For example, 

- Properties 

- Behaviors 

- Common metaphors 


Presentation 
For example, 

- Visual representations 

- Aesthetics 


Interaction 
For example, 

- Interaction techinques 

- Device mappings 

- Standard menus 


Figure 2-1 0 . The Iceberg Chart, from IBM (1992) 


tion in an interface can be. Yet, in most cases, this is not the most important as¬ 
pect of the tasks at hand. This is often just the icing on the cake or the lipstick on 
the bulldog. 

The second piece of the iceberg is the "feel" of the interface. This is the area 
we call interaction and it accounts for about 30% of the designer's model. Here the 
user interaction techniques using the keyboard, function keys, and other input 
devices such as a mouse, trackball, or joystick, are defined for the user. This also 
covers how the system gives feedback to users about their actions. A good ex¬ 
ample of consistent interaction techniques is the automobile controls we talked 
about earlier. Imagine how confused you would be if the stick-shift control were 
redesigned so you had to shift through the five gears in the opposite direction 
from how you shift your car now! 

By far the most important part of the iceberg (60%) is concerned with the 
things that are most critical to the user interface. These are the properties of ob¬ 
jects and the relationships between objects in the user interface. This is where the 
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designer determines the appropriate metaphors to match the user's conceptual 
model of the system and the tasks they are trying to do. Also note that this part of 
the iceberg is shown as being submerged and not easily visible. This is because it 
is not as obvious to programmers and designers to be concerned with this area of 
user interface design. However, it is by far the largest piece of the iceberg. It is 
also the most dangerous piece of the iceberg because a ship (a software product) 
can be hit and sunk if it doesn't pay attention to this piece of the iceberg. 


Why Should You be Concerned with Interface Models? 

The discussion on user interface models I've just gone through is not an academic 
exercise in the theoretical design of user interfaces. It is very real and has caused 
the failure of many products that may have contained incredible technological 
and functional elements, but were otherwise lacking in their attention to the user 
interface. These models should be understood by all those who participate in the 
development and use of software products. This includes the programmers, the 
designers, and last, but most important , the users of a product. 

A key lesson to be learned here is that the definition of a user interface as 
simply the look and feel of a product is not only inappropriate but is grossly in¬ 
complete. This viewpoint is overly naive and does not give user interfaces the 
credit for the role they play in user's satisfaction, perception, and performance 
with a product. Unfortunately, consumer and user first impressions are based on 
the look and feel aspects because they are the only visible and tactile parts of the 
interface available initially. Finding out if the software really works well with a 
user's model takes much more time to figure out. This situation leads consumers 
and users to equate look and feel with product usability. 

A case in point is the Macintosh interface. Mac software is perceived as be¬ 
ing much easier to use than DOS products, often because of the familiar colors, 
buttons, and icons shared by Macintosh products. But even Mac developers 
agree that some Mac software products aren't all that well designed or usable 
once you go underneath the Macintosh look and feel interface veneer. As a 
whole, most Macintosh software is very well designed, but it seems that there are 
no boundaries to poor user interface design Unfortunately, poor products aren't 
limited to the DOS, Windows, and OS/2 environment! 

News Flash: Even the Mac interface can be made easier. 
Apple customer surveys showed that some computer novices needed an even easier, 
less sophisticated interface than the Mac. Apple designed a simplified interface. 
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called At Ease, that has screen-sized file folders and extra large icons and buttons 
to launch applications with a single-click of the mouse. Weinstock (1993) points 
out that there always will be a large group of very computer-naive users, "Al¬ 
though At Ease may make the Mac more accessible to the technologically intimi¬ 
dated and the very young, it serves as a poignant reminder that even the friend¬ 
liest computers still frighten a large segment of the population." 

The discussion of the iceberg chart is also very important. The look and feel 
of the interface are the easy and more obvious parts of a product to focus on and 
build. As a user interface consultant, I've had customers ask me to help design 
their screen icons. This is before we've even discussed who the users are, what 
tasks they will be performing, and what type of interface they need! Look again 
at the iceberg chart and see where the visual aspects of the interface, such as 
screen icons, fit in. Presentation aspects of the interface account for only 10% of 
the total design of the product. Yes, icon colors, graphics, and text do need to be 
designed so that they are recognizable and understandable by users; but that should 
not be the first or most important design step. The designer's model is hopefully 
formed from the bottom of the iceberg up. In fact, as the most important aspects 
like defining the objects and metaphors used in the interface are worked on, the 
visual and aesthetic aspects of the interface, such as icons, will usually evolve 
logically and easily. 

The models I've discussed will also come up in the chapter on user interface 
guidelines. The iceberg chart, along with the psychological and perceptual con¬ 
cepts I'll discuss next, is the basis for all of the user interface design guidelines to 
follow for all of these areas. 


When Models Don't Quite Match: An Example 


In the following chapters I'll be showing you some programs to demonstrate the 
different types of user interfaces. One program you'll see lets you build a jam 
sandwich. The program was designed and coded by Chris Dekkers, an IBM 
programmer at the Uithoorn Lab, near Amsterdam. It is a great example of how 
different interface styles can be implemented for the same program or user task. 
It also points out some of the difficulties users can run into when the designer’s 
model and programmer's model don't quite match the user's own conceptual 
model. 
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Figure 2-11 . The Jam Sandwich Program 


Figure 2-11 shows one of the interface styles for the program. This is a 
graphical user interface (GUI) style. The areas inside the window represent a 
graphical layout of a kitchen and the pictures (icons) with text labels underneath 
them represent the objects you would use to make a jam sandwich. I’ll discuss 
this particular interface style in depth later. 

There are two areas of interest as far as models are concerned. First, Dekkers 
is both the designer and the programmer, so he assumes both roles in the interface 
models I've just discussed. Although this is common, it is difficult for one person 
to perform both roles. Remember, the designer’s role is to serve as the interme¬ 
diary between the programmer and the user so the two can be closely matched. It 
is extremely difficult for one person to switch hats effectively. One moment you 
must wear the user's hat and say, "Now I’m the user. What do I want to do in this 
situation?" The next moment you must put on the programmer’s hat and say, 
"How do I want to code this function in the program?" 
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Figure 2-1 2 . How the Dutch Make a Jam Sandwich 


The second area of interest regarding interface models is a cultural one. De- 
kkers is Dutch and, as such, he has his own personal and cultural concepts and 
experiences of how a Dutch kitchen is laid out and how he makes a jam sand¬ 
wich. Figure 2-12 shows the steps the program allows to make a sandwich. Is 
this how you make a jam sandwich? Maybe, or maybe not! The Dutch kitchen 
concepts and experiences are part of his mental model and consequently are part 
of the designer's and programmer's model, since they are he! I have demon¬ 
strated this program all over the United States and throughout the world in my 
consulting and education work. Most users of the program, however, don't nec¬ 
essarily share Dekkers's experiences and knowledge of a Dutch kitchen, and don't 
quite understand his method of making a jam sandwich. 
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One cultural concern is terminology. Look at the names in Figures 2-11 and 
2-12 for the kitchen furniture and the objects used to make a jam sandwich. The 
terms cupboard, drawer, refrigerator, and table should be familiar to most people, 
but do you know what a dresser is? If it weren't so critical to knowing how to make 
a jam sandwich using this program, then it wouldn't matter so much if you didn't 
know what a dresser is. Dresser is an English word, but it has multiple meanings. 
The meaning that was intended, and unfortunately required, by the programmer is 
"a table or sideboard for preparing and serving food." It now makes some sense, 
doesn't it? Even though it is an English translation of the word for the piece of 
furniture he is using, there is still a problem. In my dictionary, this meaning is 
labeled as obsolete, meaning that definition hasn't been used since 1755! The cur¬ 
rently used definitions of dresser are "a chest of drawers or bureau with a mirror" 
or "a cupboard to hold dishes and cooking utensils." The latter definition is close, 
but not really what the programmer intended. The problem is, the programmer 
requires you to use the dresser as the place where you make your sandwich. He 
won't let you make the sandwich at the table! 

This indicates the second problem with the designer/programmer's model. 
How many people make a jam sandwich exactly the same way? Do you always 
butter your bread before you put jam on it? Not in real life, but this program 
forces you to put butter on the bread before you put jam on it. Do you always put 
a loaf of bread on a bread board, or do you sometimes cut a loaf of bread on the 
table or on a plate? The problem here is that you are forced to do the task the way 
the designer determined how that task is done. The program is fun for a while, 
but when you can't do a real-world task the way you are used to doing it in the 
real world, it gets very frustrating. 

I'll talk about one of the key user interface design principles, place users in 
control of the interface, in the next chapter. Unfortunately, this program does not 
follow this design principle as well as it could. Allow users to work the way their 
own mental models tell them how to work! There is no reason why programmers 
code software programs to follow strict interpretations of the sequence of actions 
that make up the tasks users are trying to perform. 

This example should be of great interest to any multinational users and 
software developers of multilanguage and multicultural products. The cultural 
differences between users, designers, and developers of a program should be of 
major concern to software companies and consumers, since as much as one-half or 
more of a U.S. company's product sales and usage may be overseas. 
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The Psychology of Users 


"Computers may outthink us one day, but as long as 
people got feelings we'll be better than they are." 

Elvis, in "The World According to Elvis", Jeff Rovin, 1992 


As you've read this far, you know how much importance I place on involving the 
user in computer hardware and software design. As I've already discussed, in¬ 
terface design should be based on a knowledge of the user's experiences and ex¬ 
pectations. In addition, designers and programmers need to become more famil¬ 
iar with the basic physical, perceptual, and cognitive abilities of users. 

In this section. I'll cover some of the basic areas of human perception, cogni¬ 
tion and memory that should be of vital interest to you as a computer user and 
designer. There are many good textbooks on these subjects and there is a tre¬ 
mendous amount of published research that covers these areas and how they 
apply to the human-computer interface. The references listed at the back of this 
chapter are a good starting point for those interested in further readings in any of 
these areas. I'll also address the user interface aspects of computer hardware. 


Wanted: Human Factors Experts and Cognitive Psychologists 

"A surge in human factors engineering is helping software companies 
build friendlier programs. If you bring human factors people in at early 
stages, you can prevent some of these fundamentally dumb decisions." 


Jeffrey Tarter, 1990 


A better understanding of how humans perceive, store, comprehend, and re¬ 
member information will greatly help in understanding and designing computer 
user interfaces. All aspects of the interface must be designed to meet the basic 
human physical and mental abilities we all share. Interfaces are general-purpose 
tools to be used by a wide range of people and thus must also be designed to ac¬ 
commodate natural human diversity. Sounds like a tough assignment for pro- 
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"Let's begin with your feelings toward your motherboard." 


grammers and designers, doesn't it? Programmers shouldn't have to take on the 
additional role of user interface designer. Let human factors professionals and 
cognitive psychologists do their jobs. 

The general area of the study of how humans interact with objects around 
them is called human factors. Human factors engineers have been around since 
back in World War II when Air Force experts realized that changing the cockpit 
design of airplanes could reduce the number of flying accidents. 

The past fifteen years has seen a tremendous influx of many professionals 
from academic and other backgrounds into the computer industry. This includes 
cognitive psychologists, human factors engineers, instructional designers, and 
information specialists. Why has this happened? Well, the computer industry 
gradually figured something out. The products people had used with very few 
complaints were now coming under fire for being poorly designed and unusable. 
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This criticism was coming from "enlightened" users who were slowly realizing 
that computers were supposed to work for them and not vice versa. An industry 
publisher, Jeffrey Tarter (Nakamura, 1990) said, "People would put up with any¬ 
thing in the early days, so ease-of-use was less of a priority. The original Aldus 
Pagemaker was god-awful to use, it was complicated, and it crashed all the time. 
It just didn't matter because it was so much better than the alternative. But if 
Aldus came out with a product like that right now, there'd be a rebellion." 

The need for design expertise in this area is quite universal. Renato Iannella 
(1992) is a university research professor in Queensland, Australia. He agrees that 
"To truly understand the mental process that a typical user has in interacting with 
a computer system requires the knowledge of a Human Factors specialist. Such a 
person, trained in some area of behavioral science, has a knowledge of human 
abilities, limits, and methods to collect analytical data on user interfaces." 

Many computer companies have hired experts in these fields and have built 
usability labs. This effort has been lead by the industry giants such as Apple, 
IBM, Hewlett-Packard, and Microsoft. Smaller companies often use consultants 
rather than hiring a staff of professionals. The study of the human factors and 
usability of computer products is an interdisciplinary field. For example, cogni¬ 
tive psychologists have greatly helped the computer industry because they have 
studied the way people read, comprehend, and remember information. 


Are Human Factors Professionals Worth the Cost? 


"Human interface design arguably represents the most 
important single discipline in information technology. It is, 
metaphorically speaking, where the rubber meets the road." 


Daniel Gross, 1993 

Some graduate school colleagues of mine at the University of Colorado, Robin 
Jeffries and Jim Miller, now work for Hewlett-Packard. They performed a study 
(Jeffries, Miller, Warton, and Uyeda, 1991) that shows how critical human factors 
professionals and cognitive psychologists can be for interface design. A software 
product was given to four groups for user interface testing. Four human factors 
specialists were given two weeks to review the product (Group 1). A user inter¬ 
face tester observed six test subjects use the product interface and then wrote a 
report (Group 2) . Three programmers applied a set of guidelines to the product 
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interface (Group 3). Finally, three more programmers conducted a "cognitive 
walk-through" on the product (Group 4) . 

Their test results were quite interesting. They counted the total number of 
problems found by each group. They also computed the number of core prob¬ 
lems found. Core problems were a set of errors determined by a panel of seven 
interface design experts. Results showed that Group 1, the human factors pro¬ 
fessionals, found almost four times as many problems (152) as each of the other 
groups (about 39 each). They also found three times as many core problems as the 
other groups (105 to 35). After dividing by the number of person-hours each 
group took to do the product interface reviews, the researchers came up with a 
benefit/cost ratio. Group 1 had a benefit/cost ratio of 12, Group 2 was 1, Group 
3 was 6, and Group 4 had a ratio of 3. So you see, there definitely is a major ben¬ 
efit at a reasonable cost to incorporating trained and qualified human factors 
professionals in your design, development, and testing process. 


Human Perception and Attention 


"Perception can be thought of as having the immediate 
past and the remote past brought to bear on the present 
in such a way that the present makes sense." 

Robert Bailey, 1982 


Until we get computers to work for us totally by voice recognition and response, 
we must rely on the computer to present information to us visually on a com¬ 
puter display. Research on human perceptual abilities is critical even to simple 
techniques in software design. Here's just one demonstration of how computer 
systems must work within our human perceptual abilities. It’s an example I'm 
sure you can relate to. 

Have you ever had a message flash on your computer screen and then sud¬ 
denly disappear before you had a chance to read it? Frustrating, isn't it? The 
human visual system requires a certain small amount of time to react to a stimu¬ 
lus and to move your eyes to where the information is presented. It then takes 
you time to actually read the message on the screen, and you might even need to 
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read the message more than once to understand it. These basic human perceptual 
and psychological limitations and capabilities must be understood by the pro¬ 
grammer when he or she determines the time period for the message to stay on 
the screen before it disappears. 

Perception is not simply the act of seeing. It is the combination of informa¬ 
tion available through our senses (seeing, hearing, tasting, smelling, and feeling) 
with knowledge stored in memory. The process of perception is relating new ex¬ 
periences with old experiences and expectations (Bailey, 1982). Sound familiar? 
The pervasive thread of user experiences and expectations runs through the 
human-computer relationship. 

Here's a simple, yet effective example. In a classic experiment, people were 
shown either a capital letter (for example, an A) or a two-digit number (for ex¬ 
ample, 17). Then they are shown 13 (a broken capital B) and are asked what they 
saw. What would you guess they said? Yes, it does depend on what they saw 
first. People who saw a letter first tended to say it was a B, while people who saw 
a number first tended to say it was 13. Mayhew (1992) also shows this same effect 
in Figure 2-13. Reading across the row, you think the item in the middle is a 13. 
Yet, reading down the column, you recognize it as a B. Seems trivial, yet this is 
how humans work. The human perceptual system will attach meaning to infor¬ 
mation it receives, whether or not the meaning is intended or accurate. 

There is so much information in the world around you that your senses are 
constantly processing information, although you aren't necessarily aware of this 



Figure 2-1 3. Example of Human Perception, from Mayhew (1992) 


The Psychology of Humans and Computers 


63 




process. What attracts your attention are any changes in your environment. Have 
you ever been in a crowded room talking to someone, when all of a sudden you 
hear your name mentioned in some other conversation all the way across the 
room? You didn't think you were paying attention to any other conversations 
going on in the room, but when your name was barely spoken across the room, 
you knew it almost immediately! This is called the "cocktail party" phenomenon. 
It shows that your sensory system is constantly monitoring the world around 
you. This also shows that you automatically process external information to the 
point where you can attach meaning to the information, all without you being 
aware of this going on. I'll get into this more when I talk about human memory 
and cognition. 

When there is some physical change, or even a change in the meaning of in¬ 
formation you are processing, then you immediately change your focus and pay 
attention to that information. Any sudden or significant change in your percep¬ 
tual system will attract your attention. This may be the result of changes in light, 
sound, movement, color, novelty, or complexity of the information you are pro¬ 
cessing. This is why all of the bells and whistles you hear coming from your 
computer can distract you from what you are trying to do, unless they are being 
used to tell you something that you should pay attention to. 

I'm not going to go into a discussion of the human visual system here, but I 
would like to focus on what is probably the key perceptual factor in user interface 
design-color. 


The Use and Misuse of Color in Interfaces 


"Properly used, color can he a powerful tool to improve the 
usefulness of an information display system. The inappropriate use 
of color can seriously reduce the performance of such a system, however. 

Gerald Murch, 1984 


Color is probably the most often misused element in user interface design. I'll 
cover many helpful general user interface design principles and guidelines in the 
next chapters, but color is a basic area that applies equally across all computer 
hardware and software systems. There are a few things about human perception 
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and color I'd like to discuss first, before I get to the other guidelines. As 
information-processing creatures, we try to attach meaning to what we see and 
perceive. Therefore, the use of color in the user interface must be very carefully 
researched and designed. Color has primarily been used in user interface design 
as a decorative element. This limits the use of color as meaningful information in 
the interface. 

The human perceptual system is attracted to colors. This basic characteristic 
is utilized and counted on heavily by the communications and advertising field. 
Which would you rather look at, an advertisement in black-and-white or in color? 
In an article titled "The Power of Color," Wayne (1991) states, "Research studies 
into printed forms of communication indicate color is 32 percent more effective in 
attracting attention, and 25 percent more effective in causing reader action." It's 
almost a subliminal effect, something we aren't aware of. Wayne continues, 
"Corporate print advertising is almost exclusively color, precisely because indus¬ 
try studies show full-color advertisements get up to 36 percent better response 
than their black-and-white counterparts." Because color has such a strong effect 
on human perception, designers need to use color appropriately. 

People also have various and different physiological, psychological, cultural, 
and emotional responses to colors. We say, "She got so mad, she saw red," and 
"He was green with envy." We even say, "You're yellow. You're a coward!" We 
associate colors with our emotional state. Artists, painters, and decorators know 
that warm colors (reds, oranges, and yellows) evoke feelings of action and ex¬ 
citement, while cool colors (blues, violets, purples, and grays) produce peaceful 
and calming feelings. 

Here's an example of cultural differences in the use of color. The colors for 
traffic signals in the United States are green (go), yellow (caution), and red (stop). 
While this color scheme is very familiar to most drivers around the world, it is not 
totally universal. Even in countries where the same colors are used, there are of¬ 
ten color variations and even additional methods for alerting drivers. Many 
countries use blinking to signal a change in the status of the traffic light. 

I was recently driving in a European country and I couldn't figure out why 
all of the other drivers waiting at the stop lights were getting a head start on me 
as the light turned green. Well, I finally realized that the red light started blinking 
just before turning green to let you know to get ready to go. This attention- 
getting mechanism is possibly more dangerous than helpful, as most drivers 
jump the gun and go before the light even turns green. The meaning of the colors 
is somehow changed by the blinking effect. Green still (technically) means go. 
But in reality, out on the streets, it no longer means go, it means "You better get 
going fast, because everyone else has already gone!" This shows how color used 
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in a positive, attention-getting way for one purpose can cause problems in an¬ 
other area. 

The use of color in a user interface can also cause problems for people with 
visual deficiencies, such as color blindness. Although this term really doesn't 
mean that people are blind to colors, this type of visual deficiency does affect 
about 8% of Caucasian males and less than 1% of females. I happen to be a 
member of that color blind male population. While I don't notice any problems 
with colors on my computer screen, I have serious trouble sorting my socks. I 
can't distinguish very well between dark colors, that is, black, dark brown, and 
dark blue. I also have trouble differentiating very subtle pastels such as light pink 
or yellow from white. However, with computer users ranging in age from very 
young to very old, there is a tremendously wide range of visual abilities and dis¬ 
abilities that have to be accounted for both in display hardware and screen soft¬ 
ware design. I'll discuss the use of color in interfaces more in the next chapters 
and will present some design guidelines. 


Human Information Processing: Memory and Cognition 


"Never let a computer know you 're in a hurry." 

Van Mankwitz 


Computers can't think like humans (at least not yet), but at the same time, hu¬ 
mans can't do things that computers do very well. To get a better understanding 
of the way computers can and should help us to work and play better, we need to 
know more about how the human memory and cognitive systems work. 

Figure 2-14 shows the components of the human information processing and 
memory system. These components are: sensory storage, short-term memory, 
and long-term memory. I'll give you some practical examples of how each of 
these works and how computers and user interfaces can help aid each of these 
processes. 
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Figure 2-1 4. The Human Information Processing and Memory System 


Sensory Storage 

Sensory storage is where all of the automatic processing of information from your 
senses takes place. I’ve already shown you an example of this type of 
processing-the "cocktail party" phenomenon. This processing has a very large 
capacity. These buffers must be large and hold a very high level of detail to be 
able to automatically handle all of the information your senses are monitoring. 

Think of your sensory processors as your interface sentries or outposts look¬ 
ing for information in the world around you. They don’t have to be very smart, 
but they have to be very attentive to all that is happening around them, and they 
have to be very quick to spot any changes that they see. Because there is so much 
going on around you, the sensory system can't keep information around very 
long; it has to keep bringing in new information. Remember, this is all happening 
without you paying any attention to these processes. When something happens 
that causes you to pay attention to it, then the information is passed on to the 
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higher memory functions. I discussed this area earlier when talking about per¬ 
ception and attention. When you're watching a movie, you don't realize that you 
are actually seeing a steady flow of static frames of film. Your sensory system is 
processing that information, frame-by-frame, as fast as it can. Your higher-level 
processes smooth out all of the sensory information so that you perceive the 
movie as one continuous image. Only when the movie projector breaks down 
and the frames aren't shown so fast do you notice that you were watching indi¬ 
vidual frames of film. 


KEY IDEA! 


What does this mean for computer developers and users? 
Let's go back to the flashing message example I used earlier. Remember the one 
that disappeared before I could read it? A message must remain on the screen 
long enough for a user to not only realize that the message is there, but for the 
user to pass on the information to higher functions to read and respond to the 
message. Also be aware that your sensory system is taking in information from 
everything that is on the computer screen. You may think your new animated 
screen background program is fun and cute to watch. However, you are really 
trying to work in one window on the screen while the animated background is 
running. What you don't know is that your sensory system is doing a lot of un¬ 
necessary work. You are processing all of that activity going on in the screen 
background while you are trying to work in the window in the middle of the 
screen. This extra visual processing may even cause eye strain and fatigue. 


It has been found that constant or repeated stimulation actually tires the 
sensory mechanisms and they become less attentive and less able to distinguish 
changes. This is called habituation , and it applies to all sensory information, in¬ 
cluding information on your computer screen and in your physical environment. 
All factors, including light, temperature, sound, motion, and color affect your 
senses in this fashion. Now you see why all elements of the computer interface 
are important and must be designed to serve a definite purpose for the user. 


Short-Term Memory 

Your short-term memory (STM) is the second stage of information processing. In¬ 
formation that is recognized and perceived is passed on from sensory storage to be 
processed further. STM also gets information from your permanent memory 
(, long-term memory , or LTM) through the process of cognition. STM is the weakest 
link, or bottleneck, in the whole information processing system. It is a memory 
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buffer that is limited in capacity to about seven plus or minus two items (that is, 
between 5-9 items). Also, new information coming into STM bumps out older in¬ 
formation if the buffer is filled. Information can only be maintained for a limited 
amount of time, at most about 30 seconds, without practice. STM is also called 
working memory because this is where you do your thinking, or processing of 
information. If I asked you to multiply 6 times 538 in your head, you would be 
doing this processing in short-term memory. 

It's easy to see how STM works. It is also very important for designers and 
programmers to know about people's STM limitations when interacting with 
computers. For instance, computers have easier access to stored information, 
while we have to work much harder to get to information we may already know. 
As an example, let's look at telephone numbers. 

The telephone company has all of it's phone numbers stored in computers 
and also printed in phone books. If you need a phone number you don't know or 
can't remember, you can either look it up in a phone book, if there is one avail¬ 
able, or call the phone company. Either way, you have to somehow remember the 
number you find long enough for you to make your telephone call. What do you 
usually do when using a phone book? You may write down the phone number, 
which serves as an external memory aid, so when you go to dial the phone you 
don't even have to remember the number. You may try to remember the number 
in your head, which means you have to keep the number in your STM long enough 
so it is still there when you dial the phone. Just how do you keep the phone 
number in your head? If you are using the phone book in one corner of the room 
and have to walk to the other corner of the room to use the phone, you'll have to 
keep the number from being lost or replaced in memory. 

People use various strategies to keep information in short-term memory. 
These techniques include rehearsal and chunking. We use whichever technique is 
easiest or most appropriate for the type of information, and they can be com¬ 
bined. A telephone number can be rehearsed simply by saying it aloud or silently 
to yourself. However, remember that any other new information or distraction 
may cause you to lose the numbers you're rehearsing. As you're repeating the 
phone number someone might mention to you "Hey, it’s eleven thirty-five al¬ 
ready, let's go to lunch!" The numbers you were just rehearsing have probably 
disappeared from your head and now you're repeating "11:35, 11:35" and you're 
wondering what happened to the phone number you were trying to remember. 

Chunking is a very important memory strategy. It involves taking many 
pieces of information and grouping them together by associations, order, and 
meaning. Chunking is used both in remembering information in STM and in 
LTM. Remembering the phone number 123-4567 is easy. You have taken seven 
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digits and now only have to remember two items: start at one, and increase each 
number by one. 

Take a look at the phone numbers that businesses choose. They try to use 
numbers that customers can easily remember by chunking to create something 
more meaningful to remember. For example, 1-800-IBM-SERV might be used as 
the toll-free number for reaching IBM's Service Center. My bank's automated 
teller machine (ATM) is called LOGIC and my password can be five digits. So I 
use the numbers that spell L-O-G-I-C on the ATM and I don’t even have to re¬ 
member which meaningful code I used for my password. Unfortunately, credit 
card and bank card thieves are just as clever and could probably figure out my 
ATM card password very easily! 

Even the telephone company uses computers to provide support for our 
short-term memory limitations. If you call for information, the operator will 
usually transfer you to an automated system. The system will announce your 
number twice. Why do they repeat the number? To help with your short-term 



Figure 2-1 5. Chunking and Repetition in Short-Term Memory 
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memory! It is allowing you to make sure you heard the number correctly and it is 
helping you rehearse the number. The phone company is even smarter than you 
had thought. Instead of having to remember the number, hanging up and then 
dialing the number, the phone company will even call the number for you. If it is 
a number that you don't need to remember (place in long-term memory), then for 
50 cents you can let the phone company do the work of your short-term memory 
for you. Just think, ingenious computer developers can make money by under¬ 
standing about human memory and cognition and counting on people's willing¬ 
ness to let someone else do their mental processing for them! 


KEY IDEA! 


Computer product designers should be aware of short-term 
memory characteristics and limitations when designing interfaces. For example, 
if a user is trying to fill in information on a screen and they ask for help on one 
particular item, don't cover up that item with help information so they can't see 
what they wanted help for in the first place! Makes sense, right? Unfortunately, 
many developers aren't even aware they've done this to their users. I call this 
type of help information "destructive help" because it covers up what they are 
trying to focus on. I've seen users go back to the help screen two or three times 
before they got all of the information they needed. It couldn't be that difficult for 
designers to build the help system so it doesn't cover up the user's information. 


Another annoying habit designers have is to force users to remember in¬ 
formation from screen to screen, or even retype information they just typed. The 
computer can easily bring previous information along and have it available on the 
next screen, but the designer just didn't think about it or didn't ask the product 
users. I travel continuously and am always on the telephone with travel agents or 
airline, hotel, and rental car reservation agents. I'm constantly amazed that they 
often have to ask me for my customer number or address multiple times because 
they are on a different screen from the first time they asked me for the informa¬ 
tion. They usually apologize for the inconvenience and remark that they don't know 
why the computer makes them type the information again when it already has 
the information on another screen. 


Long-Term Memory 

Long-term memory (LTM) is analogous to the phone company's database of 
telephone numbers in their computer or the phone book you have available as a 
customer. LTM is a memory storage warehouse of possibly limitless capacity and 
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duration. Computers are also large-capacity, permanent storage devices, but they 
have different strengths and weaknesses (see Figure 2-16). The main problem lies 
not in the amount of information we can remember or for how long, but how to 
access the information. Finding the correct information in the telephone company's 
computer or from a phone book might be easier than trying to remember a phone 
number you once knew, but it isn't perfect. How can you possibly find Jane Smith's 
phone number in the phone book if you don't know her address? There are too 
many Smiths in the phone book for you to find her number without any addi¬ 
tional information. The information may be there in the computer and in your 
long-term memory, but you don't have the ability to retrieve the information. 

How many times have you tried to remember someone's name or the title of 
a movie and been so close to remembering it, but not quite? This is called the 
TOT, or "Tip-of-the-Tongue," phenomenon. You are so close to remembering 
something it almost hurts! You know how it sounds, or what the first letter is, or 
what the person looks like, but you can't quite make the final connection. You 
can remember some, but not all, of the features of the information. The amazing 
thing is that if you stop thinking so hard about trying to remember the informa¬ 
tion, usually a few seconds later it will just pop into your head. This shows that 
our LTM storage is extremely complex and information is multicoded in a rich 
network structure. By remembering a few features of the information you have 
reestablished a few of the links in the network and can usually get to the infor¬ 
mation given a little time. 

As there were strategies for helping keep information in STM, there are also 
strategies for helping to retrieve information. Mnemonics involve attaching 
meaning to information you are trying to remember. Part of the telephone num¬ 
ber you are trying to remember might be the street address of your old house. 
You then need only to think of "your old house" and that will help you remember 
the number. People have trained themselves to accurately remember amazingly 
long lists of items by creating internal visual "hooks" on which they can hang each 
piece of information they are trying to remember. They can then mentally go to 
each hook and retrieve the item from the list that they hung on that hook. There 
are waiters and waitresses who can remember the food and drink orders for all 
the people at a large table by successfully using strategies such as this. 

We also use chunking strategies in LTM with items we always have to re¬ 
member like our home and work telephone numbers, social security number, 
ATM codes, computer passwords, and so on. Your social security is a nine-digit 
number, which is a long string of numbers to remember. However, you probably 
don't think of your social security number as nine separate numbers. You think of 
it as three numbers with three, two, and four digits in each number. You've just 
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taken nine individual numbers with no logical connection and chunked them into 
three numbers that fit together. 

Since long-term memory retrieval is a major problem for users, computer in¬ 
terfaces should be sensitive to this and offer support wherever they can. The two 
main methods for retrieving information are recognition and recall. Notice the 
convenient memory mnemonic aid for remembering this topic: Retrieval is Rec¬ 
ognition and Recall. Just remember 3 Rs and you've got it. That's using mne¬ 
monics and chunking strategies! 

Why force users to have to recall information, even if they do know it? Why 
not give them a menu or list and let them recognize an item? Recall usually in¬ 
volves trying to retrieve information without any cues. What is the keyboard as¬ 
signment for pasting text in a document from your favorite word processor? Rec¬ 
ognition involves trying to retrieve information with some cues present. Look on 
the Edit menu on the word processing screen and you can just select the Paste 
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choice and it should also tell you that Shift+Insert on the keyboard will do the 
same action. 

This has been a brief tour of the human information processing system. This 
knowledge should be useful for both users of computer interfaces and the de¬ 
signers and developers of computer products and interfaces. Mayhew (1992) 
provides a good summary of the strengths and weaknesses of humans and com¬ 
puters in Figure 2-16. 

User interface guidelines and textbooks are very useful for 
helping designers and developers to design user interfaces based on what we 
know about people's cognitive and perceptual abilities. Some of these are listed 
in the reference section for this chapter. Remember, one of the most important 
things an interface can do for users is to reduce their reliance on their own 
memory and use the computer's strengths to support users' weaknesses. 
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Why should designers and programmers need to follow principles, standards, 
and guidelines? In the past, as I've discussed, computer software was designed 
with little regard for the user, so the user had to somehow adapt to the system . You 
are now learning that this approach to system design is not at all appropriate to¬ 
day. Hopefully, by now you know: the system must adapt to the user. 

Computer users should have successful experiences that allow them to build 
confidence in themselves and establish a self-assurance about how they work 
with computers. Their interactions with computer software should be "success 
begets success." Each positive experience with a software program allows users 
to explore outside their area of familiarity and encourages them to expand their 
knowledge of the interface. Well-designed software interfaces, like good educa¬ 
tors and instructional materials, should build a "teacher-student" relationship that 
guides users to learn and enjoy what they are doing. Good interfaces can even 
challenge users to explore beyond their normal boundaries and stretch their un¬ 
derstanding of the user interface and the computer. When you see this happen, it 
is a beautiful experience. 

Principles, standards, and guidelines serve to help designers and program¬ 
mers develop products with the user in mind. A general design process should 
also be followed to ensure that the implementation of these concepts has been 
successfully accomplished. Many people in the computer industry use the terms 
principles, guidelines, and standards interchangeably. One goal of the next few 
chapters is to show you that these terms have very different meanings and play 
different roles in user interface design. 


The Golden Rules: Interface Design Principles 


The guiding light that all designers and programmers should follow is an under¬ 
standing and awareness of the user's mental model and the physical, physiologi¬ 
cal, and psychological abilities of users. This information has been distilled into 
general principles of user interface design, which are agreed upon by most experts 
in the field. Think back on the iceberg chart in Chapter 2. User interface design 
principles address each of the key components of the iceberg: presentation, in¬ 
teraction, and object relationships. 

Although all of the interface design books I'll mention have their own names 
and descriptions for the various principles, they all fall into three basic categories 
(IBM, 1992). I've combined specific principles from various sources to give you as 
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complete a listing as possible. Some discussion of the key principles in each cat¬ 
egory will follow. Later on you'll see these design principles in action. The three 
golden rules of user interface design are: 

® Place users in control of the interface 
® Reduce users' memory load 

• Make the user interface consistent 

It is important to remember that user interface design principles aren't just a 
list of nice things to think about if you have extra time during product design. 
These principles are not a multiple-selection list of options. They all interact with 
each other and are inextricably intertwined in the fabric of a well-designed user 
interface. A Chinese lunch menu approach (choose one item from column A and 
one item from column B) doesn't work well when designing interfaces. 


Where Should You Look for Interface Design Principles? 

You will find many sources that discuss principles of user interface design. I've 
listed some of the key books in the reference section of this chapter. These books 
fall into two categories: textbooks and software design guides. Some good text¬ 
books on user interface design are Mayhew (1992), Shneiderman (1987), Heckel 
(1984), and Rubenstein and Hersch (1984). 

The major software corporations have all either published or republished 
their design guidelines and reference materials in 1991 or 1992. This literary 
frenzy shows how critical it is for designers and programmers to keep up to date 
with these materials. The major software design guides include Apple Computer, 
Inc. (Apple, 1992), IBM Corp. (IBM, 1992), Microsoft Corp. (Microsoft, 1992), and 
OSF/Motif (Kobara, 1991). All of these design guides address user interface de¬ 
sign principles for their development environment. 

Users, designers, and programmers should use the publications that best 
address their learning and working environment (hardware, operating system, 
and key software products) and should follow the principles discussed there. The 
terminology may differ slightly between books, but you can be sure they all ad¬ 
dress the user interface principles that make up these major categories. 
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Why Should You Care about Interface Design Principles? 

"The conclusion: Interface inconsistency can cost a big company 
millions of dollars in lost productivity and increased support costs. 


Jesse Berst, 1993 


The principles I'll discuss are generally thought to be common across all com¬ 
puter hardware and software environments. They also apply across all interface 
types and styles. They have evolved over time through many years of interface 
design efforts, research, testing, and user feedback in computing environments 
from mainframes to the Mac. 

These principles should even endure as new user interface technologies 
emerge. Jakob Nielsen (1990), a Danish professor, noted, "The principles are so 
basic that even futuristic dialogue designs such as three-dimensional interfaces 
with DataGlove input devices, gesture recognition, and live video images will 
always have to take them into account as long as they are based on the basic para¬ 
digm of dialogues and user commands." 

The actual implementation of these principles will, of course, vary according 
to the hardware environment, operating system, and user interface capabilities of 
the system. Often, business decisions influence the designer's use of the prin¬ 
ciples and the priorities that may be assigned to them. The user's and designer's 
models should also determine how the principles are applied to user interface 
design. Again, remember the phrase I told you earlier, "Know thy users, for they 
are not you." You'll see examples as we continue. At many points in the interface 
design process you'll be asking yourself the question, "What happens next?" The 
answer should be, "Whatever users want to do!" 

Users should know about these interface design principles to help evaluate 
the products they purchase and use. Also, users' business environment may af¬ 
fect what they are looking for in terms of the principles implemented in the inter¬ 
face. Managers, team leaders, and workers should figure out together which key 
principles are the most appropriate for their environment and work tasks. They 
should then focus on purchasing or developing software products that offer us¬ 
able and productive interfaces that are based on those key principles. 
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Golden Rule #1: Place Users In Control 


The first set of principles addresses placing users in control of the interface. A 
simple analogy is whether to let people drive a car or force them to take a train 
(Figure 3-1). In a car, users control their own direction, navigation, and final des¬ 
tination. One problem is that drivers need a certain amount of skill and knowl¬ 
edge before they are able to successfully drive a car. Drivers also need to know 
where they are going! A train forces users to become passengers rather than driv¬ 
ers. People used to driving their own car to their destination may not enjoy the 
train ride, where they can't control the schedule or the path a train will take to 
reach the destination. However, novice or casual users may enjoy the train if they 
don't know exactly where they are going and they don't mind relying on the train 
to guide and direct them on their journey. The ultimate decision to drive a car or 
take the train should be the user's, not someone else's. Users also deserve the 
right to change their mind and take the car one day and the train the next. 



Figure 3-1 . Do Users Want to Drive a Car or Take a Train? 


The Golden Rules of User Interface Design 


81 





Let's first look at a banking environment where computer users range from 
bank presidents to bank tellers. Presidents have more flexibility and authority in 
the tasks they can do with the computer system. Meanwhile, bank tellers have a 
much more limited set of tasks they perform. Their tasks are customer-directed 
and are repeated very often throughout the work day. Tellers should also not be 
allowed to access the tasks and information that bank presidents work with. 

The design principles that place users in control should be used appropri¬ 
ately to allow bank presidents system-wide access and control. The tellers, how¬ 
ever, should be given an interface that allows them to work within their limited 
set of tasks. The interface should also give them some degree of control and flex¬ 
ibility to do their tasks quickly, comfortably, and efficiently. In this environment, 
the interface designer must determine which of these principles are most impor¬ 
tant when designing the bank's computer system to be used by the all of the us¬ 
ers. 


KEY IDEA! 


Here's a classic example of a wise designer who let users do 
his work for him rather than attempt to figure out what they want. After design¬ 
ing a complex of buildings, an architect was supposed to design the walkways be¬ 
tween the buildings. He was smart enough not to assume that he knew how us¬ 
ers would really use the walkways between buildings. So he didn't design the 
walkways or build them at the same time as the buildings. Rather, he had fields 
of grass planted between the buildings. A few months after the buildings were 
completed, he came back and saw where people made paths walking across the 
grass between buildings. Then he knew where he should put the walkways. This 
is a wonderful, real-life example of a designer letting users be in control, observ¬ 
ing their behavior, and then building an interface that allows them to go where 
they want to go and how they want to get there. 


The principles that allow users to be in control are listed in Figure 3-2. After 
each principle I've listed a key word to help you remember these principles. Let's 
look at some examples of a few of these design principles in action. 


Use Modes Judiciously 

Here's a very familiar example of modes from the "real world" of VCRs. When 
you press the fast forward or rewind button on your VCR or on the remote con¬ 
trol, you don't always get the same response from the VCR. Why? Well, it de¬ 
pends! The system's response depends on which mode the VCR is in-either the 
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Figure 3-2. Principles that Place Users in Control 


stop mode or the play mode. If the VCR is stopped, then the fast forward or re¬ 
wind buttons fast forward or rewind the tape very quickly. However, if the VCR 
is playing, then these buttons search forward or backward, showing the picture on 
the TV. The search functions don't move the tape as quickly as the fast forward 
and rewind functions. 

Say you've just finished watching a rental videotape. You want to rewind 
the tape so you won’t be charged a rewinding fee when you return the tape to the 
video store. You press the rewind button while you're watching the film credits 
on the screen and turn off the television. You won't even know that the VCR is 
really searching backward in the play mode. This could take a very long time 
and since the television is turned off, you can’t even see that the VCR is still in the 
play mode. What you probably wanted to do was to press the stop button first 
and then press rewind. This would rewind the tape quickly, taking much less 
time and placing less strain on your VCR. 
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This whole episode I just described recently happened at home to my wife. I 
had bought a new VCR and she wasn't very familiar with its operation yet. She 
was rewinding a tape with the television off and she commented that it seemed to 
be taking a long time to rewind the whole tape. I looked at the display on the 
front of the VCR and sure enough, there was an indicator arrow ( ) showing that 
the VCR was still in the play mode. After I explained this to my wife, she said, 
"That's a stupid way to design a VCR! Why don't you use that as an example in 
your book." 

Have you ever used a graphical drawing program on your computer? The 
palette of drawing tools you use is an example of the use of modes (see Figure 
3-3). When you select the draw tool, you are in the draw mode . Your mouse 
movement, mouse button presses, and keyboard keystrokes will all produce some 
type of drawing actions. Then select the text tool, and the same mouse and key¬ 
board actions produce text and text functions. Modes are a necessary part of 
many software interfaces. You probably can’t avoid using modes altogether, but 
use them only when needed. Another example of an unavoidable mode is in any 
word processing program. When you are typing text, you are always in a mode, 
either the insert mode or the replace mode. 

It's easy to find interfaces that put users in modes unnecessarily. Any time a 
message pops up on your computer screen and you can't do anything else in the 
program or even anywhere else on the screen, you're imprisoned by a modal dia¬ 
log! There are two types of interface modes, and although they may be necessary 
in some cases, they are not needed or are unnecessarily restrictive most of the 
time. 

The first type is application modal. Here the mode you are in will not allow 
you to work elsewhere in the program, or it places you in a certain mode for the 
whole program. For example, if you are working with a database of information 
and you choose the view data mode, the program will not allow you to change 
data no matter which data record you happen to be working with. You would 
have to change to the update data mode. This may be appropriate for users who 
are only allowed to browse the database, but if users are constantly viewing data 
and wish to change data they have access to, why should they be forced to change 
modes all the time? Why are you forced to either be in view or update mode in 
the first place? A more user-friendly approach is to let users access the data 
without being forced to choose any mode. If they choose to modify any data, 
they should be able to save the data and update the database with a convenient 
action. If they don't make any changes, they can access a new data record or exit 
the record, without having to make any decision about program modes. Perhaps 
the best method is to display data in a format that is consistent with a user's ac- 
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Figure 3 - 3 . Tool Palette Modes in a Drawing Program* 


cess. If limited access, display static text; if update access, provide entry fields 
that are updateable. 

The second type of mode is called system modal. This type of mode should 
rarely be forced on users. While in a system mode, you are not allowed to work 
anywhere else on the computer until the mode is ended, or it places you in a cer¬ 
tain mode no matter what program you are using on your computer. Let's say 
you are printing a document and a message window pops up to let you know 
your printer is out of paper. You should not have to get up and put paper in the 
printer immediately, or even remove the message from the screen. You should be 
able to continue working with your word processing program or do anything else 
on your computer. You might even want to keep the message window on the 
screen to remind you to add paper later. Programs sometimes take control of the 
entire system when they present messages on the screen. There is no reason why 


The Golden Rules of User Interface Design 


85 

















the "Printer out of paper" message should be a system modal dialog. Watch out 
for this especially when designing and programming messages and help infor¬ 
mation. You can see how frustrating system modes can be for users. 


KEY IDEA! 


The key design philosophy is to let users choose when they 
want to go into a particular mode, rather than forcing them into a mode based on 
where they are in the program or in the interface. The true test of the use of 
modes in an interface is if users don’t think of being in a mode or if the modes are 
so natural to them that they feel comfortable using them. 

When using modes, it is also important to follow the principle of immediate 
visual feedback. Every time the user chooses a mode there should be some visual 
feedback the whole time they are in that mode. Many programs change the 
mouse pointer or the text selection cursor to show the current mode. This is an 
example of the interaction between principles and the importance of following all, 
rather than just some, of the design principles. 


Provide Immediate and Reversible Actions and Feedback 

Airline crews rarely used to tell passengers when they were experiencing diffi¬ 
culties with an aircraft on the ground or in the air. There were usually no an¬ 
nouncements as to what the problem was or how long it might take to fix the 
problem. Passengers got very restless and impatient without any feedback. 
Studies found that people are much more forgiving if they are told the truth about 
what is going on and are given periodic feedback about the status of the situation. 
Now, airline pilots and crews make a point to periodically announce exactly what 
the situation is and how much time they expect to take to resolve it. 

I recently went to the MGM Studios theme park in Orlando, Florida. The 
most popular ride is the "Back to the Future" adventure and there are always long 
lines of people waiting to get in. Signs are posted in front of each ride telling 
people how long the estimated waiting time is to get into the ride. There was a 45 
minute wait for this popular ride when we were there. However, the entry areas 
for all the rides are designed like a maze, with walkways winding around and 
around in a very small space, so you are constantly moving and turning in dif¬ 
ferent directions as you make gradual progress toward the ride entrance. Televi¬ 
sion monitors preview the ride at stations along the way so that everyone stand¬ 
ing in line can see and hear what they are about to see in the ride. 

The entry areas and the television monitors were designed specifically to 
keep people moving at all times, to distract them, and keep them entertained. It 
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is very important that an "illusion of progress" be felt by users, whether it is 
people standing in line for an amusement park ride or computer users waiting for 
a program to complete an action or process. The use of feedback and progress 
indicators is one of the subtle aspects of a user interface that is of tremendous 
value to the comfort and enjoyment of users. 


Allow Users to Customize the Interface 

Allow users to customize information presentation (colors, fonts, location, ar¬ 
rangement, view types), interface behavior (default actions, macros, buttons), and 
interaction techniques (keystrokes, shortcut keys, mnemonics, mouse button map¬ 
pings). The rich visual and sensory environment of graphical and multimedia 
user interfaces requires users to be able to customize the interface. Users feel 
more comfortable and in control of the interface if they can personalize it with 
their favorite colors, patterns, fonts, and background graphics for their desktop. 


Allow Users to Use Either the Keyboard or Mouse 

One of the key CUA design principles is that users must be able to do any action 
or task using either the keyboard or the mouse. Users have very different habits 
about using keyboards and mice and often switch between them during any one 
task or while using one program. With the push toward mouse-driven, direct- 
manipulation interfaces, not all of the major design guides follow this philosophy 
of implementing both a keyboard and mouse interface. However, designers may 
want to follow this principle for the sake of users as they migrate to graphical in¬ 
terfaces and for consistency with other programs that may only have keyboard 
input. As I'll discuss later, users with special needs usually require an interface 
with keyboard access. Some new interface techniques also may need keyboard 
support to ensure user productivity. 


Let Users Think They're in Control 

As you can see, it is recommended that users be given some control of the user 
interface. In some situations, users should have total control of what they can do 
across the operating system. In other environments, users should only be allowed 
to access and use objects and programs that are needed for their work tasks. It is 
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human nature for people to be frustrated when they want to go somewhere and 
they can’t get there quickly, or they can’t take the route they would normally take. 
Well, there are times where a computer system or program takes a certain amount 
of time to do some action or process and there is nothing the designer or pro¬ 
grammer can do to speed it up. What do you do to keep users informed of the 
progress of the action and keep them from getting upset? Is there any way to 
keep users busy so they won't think that the computer is slow or not working? 
Let’s learn from the real world how to solve this problem. 

A maintenance supervisor for a large office building was getting complaints 
from hurried office workers in the building that the elevators were too slow. The 
supervisor knew that there was very little he could do to improve the speed of the 
elevators. He said to himself, "What can I do to take their minds off how slow the 
elevators are?" 

In his infinite wisdom, he figured out that if he installed mirrors inside the 
elevators, that just might keep passengers occupied while the elevators travelled 
at their normal speed. Guess what? He never got another complaint about the 
slowness of the elevators after the mirrors were installed. The problem with the 
speed of the elevators could not be solved, but users' perception of the problem 
could be influenced by the designer. Elevator floor information lights and 
sounds, both inside elevators and in elevator lobbies are also designed as visual 
and auditory progress indicators. Mechanical and electrical engineers know it is 
a good idea to show the elevator's status or progress, both to inform users and to 
let them pass the time quickly. 


KEY IDEA! 


There are two lessons to be learned here for interface design. 
One, a well-designed interface can comfort and entertain users while the com¬ 
puter system is completing a process. Two, users don't like to be left just sitting 
there doing nothing and seeing nothing on the computer screen while the com¬ 
puter is supposed to be doing something. The moral is, even if you can't put us¬ 
ers in control, let them think they are! 


Many product designers and programmers (or maybe their marketing staff) 
have figured out they have a captive audience while users are loading the nu¬ 
merous diskettes it takes to install a software program today. I've seen a number 
of installation programs that present advertisements on the screen while users are 
just sitting there as the computer is reading the disk. Users can't help but read 
what is presented on the screen. Some even use this to teach users about the 
product so they can become more productive sooner. 
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I discussed the capabilities and limitations of the human memory systems in great 
detail in Chapter 2. Based on what we know about how users store and remem¬ 
ber information, the power of the computer interface should help reduce users' 
memory load while using the computer. Figure 3-4 lists the design principles that 
should guide designers and programmers in this area. 


Relieve Short-Term Memory 

If you remember (since it was discussed in Chapter 2, it's probably in your long¬ 
term memory by now!), short-term memory helps keep information available so 
you can retrieve it in a very short period of time. Users are very busy doing many 



Figure 3-4. Principles that Reduce Users’ Memory Load 
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things at once, so computer interfaces shouldn't force them to try to keep infor¬ 
mation in their own short-term memory during their tasks. In terms of what de¬ 
signers can do in the interface, don’t force users to have to remember and repeat 
what the computer could (and should) be doing for them. For example, when fill¬ 
ing in online forms, customer names, addresses, and telephone numbers should 
be remembered by the computer system once a user has entered them. I've talked 
with countless airline, hotel, and car rental phone agents who know they need the 
same information a few screens later. They have to try to remember the informa¬ 
tion until they get to the later screen, or they have to write down the information 
while talking to the customer so they have it when they get to the other screen. 
The system should be able to retrieve the previous information so users don't 
have to remember and retype the information again. It is such a simple interface 
principle, but one that is often neglected. 


Assist Long-Term Memory 

Computers should support long-term memory retrieval by providing users with 
items for them to recognize rather than having to recall information. Provide lists 
and menus instead of fields where users must type in information without sup¬ 
port from the system. Why should users have to remember the two-character 
abbreviations for each state of the United States when they are filling out an 
online form? Don't force them to memorize codes for future use. 


Organize Information on the Screen 

Apply the visual design principles of human perception I discussed in Chapter 2, 
such as grouping items on a menu or list, numbering items, and by using head¬ 
ings and prompt text. Think of information on the screen in the same way as in¬ 
formation you would present in any other medium. Graphic artists and book 
designers are skilled in the art of presenting information using the right medium 
and then designing the presentation of that information appropriately. There are 
general principles of organization, continuity, gestalt, and so on that should be 
followed. Avoid arbitrary groupings, distinctions, and other elements that seem 
to provide organizational information, but really don't. Remember the old adage, 
"form follows function." 
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Provide Defaults, Undo, and Redo 


This is similar to using the computer to assist both short-term and long-term 
memory. Following the golden rule of placing users in control, interfaces allow a 
wide variety of customizing features. With the power to change the interface, you 
should also give users the ability to reset choices and preferences to the defaults 
set by the system or the program. Otherwise, users can mess up their system 
colors, fonts, and settings so badly that they have no idea what the original set¬ 
tings were and how they can get them back. Utilize the computer's ability to 
store and retrieve multiple versions of users' choices and system settings. 

While editing and manipulating data, such as writing text or creating graph¬ 
ics, undo and redo are very important to users. Undo lets users make changes 
and go back step by step through the changes that were made. Redo lets users 
undo the undo, which means that once they go back a few steps, they should be 
able to move forward through their changes again, step by step. Most programs 
allow users to undo and redo their last action, or maybe even the last few actions. 
A few programs can offer what is called "infinite undo." DeScribe version 4.0 for 
OS/2 actually saves every keystroke and action during your entire working ses¬ 
sion and you can move forward and backward, step by step or in larger incre¬ 
ments, to restore your document to any state it was in during your session. 


Golden Rule #3: Make the User Interface Consistent 


The consistency of user interfaces is one of the key aspects of making interfaces 
usable. It's also one of the major areas of debate, as you'll see in the next chapter. 
However, just like any set of principles, consistency might be a lower priority for 
users of a system than other factors, so don't follow consistency principles and 
guidelines if they don't make sense in your environment. Figure 3-5 lists the 
design principles for user interface consistency. 

Next time you're on a commercial airplane, notice all of the little signs on the 
walls and doors of the toilets. Each of the signs has an identification number on 
one corner of the sign. This is done to ensure consistency in the signs you see on 
every airplane. It also simplifies the process of tracking and installing signs for 
airline workers. This is a good idea for help and message information you may 
develop for computer software programs. 

Once you create an information message, give it a message identification 
number. Then, everywhere that the message is appropriate, use the same mes- 
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sage number instead of writing the message again or writing a similar message. 
This will ensure that users will see the very same messages every time they are in 
the same situation no matter where they are in the program or in the system. This 
layer of consistency is very comforting and friendly to users. 


Maintain Consistency Within and Across Products 

This principle is one of the most important factors behind users being able to 
learn general concepts about system and product interfaces and then apply what 
they've learned to new situations in different programs or different parts of the 
system. This consistency applies at all levels: presentation, behavior, and inter¬ 
action techniques. 



Figure 3-5. Principles that Make the Interface Consistent 
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Consistency in presentation means that if information that users can't change 
(called static text) is in blue on one screen, then static text on all other screens 
should also be presented in blue. These types of presentation guidelines will be 
discussed in the next chapter. Don't change presentation styles within your 
product for no apparent reason. 

Consistency in behavior means that the way an object works is the same ev¬ 
erywhere. The behavior of interface controls such as buttons, lists, and menu 
items should not change within or between programs. I've seen programs where 
the menu bar choices immediately performed actions, instead of displaying 
pull-down menus, as everyone expects. Users should not be surprised by object 
behaviors in the interface. 

Interaction technique consistency is also important. The same shortcut keys 
should work in similar programs. Mouse techniques should produce the same 
results anywhere in the interface. Keyboard mnemonics should not change for 
the same menus from program to program. Users expect the same results when 
they interact the same way with different objects. 

Learning how to use one program should provide what is called positive 
transfer when learning how to use another similar program interface. When 
things that look like they should work in a different situation don't, what you 
have is negative transfer. This can inhibit learning and does not let users feel con¬ 
fident about the consistency in the interface. 

Consistency is one of the key issues behind user interface guidelines and 
standards that I'll discuss in the next chapter, so keep on reading! 


Encourage Exploration 

The goal for most user interface designers has been to produce user-friendly in¬ 
terfaces. A friendly interface encourages users to explore the interface to find out 
where things are and what happens when they do things, without fear of negative 
consequences. Interfaces today and in the future must be more intuitive, enticing, 
predictable, and forgiving than most interfaces we've developed and used. Let's 
move onward past user-friendly to user-seductive. 
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CHAPTER 


Interface Standards 
and Guidelines 


"I can't tell you what I want, 
but I'll know it when I see it .' 


A Computer Software User 




User Interface Standards 


"The trouble with standards for computers is that you don't want to 
standardize so much as to stymie further product improvements." 

John Karat, 1991 


Standards are somewhat different from the principles I discussed in the last 
chapter and the guidelines I'll cover next. The goal of standards is to make our 
lives easier by defining characteristics of objects and systems we use every day 
The layout of telephone keypads, for example, is a standard you depend on. If 
you're a typist or a computer user, you should feel comfortable using the standard 
QWERTY keyboard (named for the top left row of alphabetic keys) , even if you 
have to use a different typewriter or computer. 

There are standards across all industries, including the construction industry. 
Standards allow the home architect and builder I discussed earlier to communi¬ 
cate with everyone involved with home construction. They can transfer their 
knowledge into the design and building of a home mainly because they all un¬ 
derstand the standards involved in the construction business. There are electrical, 
mechanical, plumbing, and environmental standards that enable everyone to do 
their job easier and better. 

The computer industry has standards in many areas. Hardware standards 
have been defined for computer displays, keyboards, system units, and even 
furniture. For example, there are standard cables, connectors, electrical busses, 
and electronic transmission protocols. If you need a cable to connect your com¬ 
puter to your printer, it will most likely be a standard parallel printer cable with 
the standard connectors for the computer and the printer. Most of the hardware 
standards address the important ergonomic human-computer interface areas. For 
example, one international standard states, "The slope of the keyboard shall be 
between 0 and 25 degrees." 

Software standards usually apply to basic user interface characteristics. 
Gould (1988) tells us why software standards have evolved, "The stated motiva¬ 
tions for developing user interface standards are to make information processing 
equipment easier and safer for people to use through establishing minimum 
manufacturing requirements and by eliminating unnecessary inconsistencies and 
variations in the user interfaces. Standards can be seen as a way of insuring that 
good human factors are incorporated in the system." 
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There are even standard paper sizes in the U.S. and internationally. You 
might be able to see the benefits of this standard in your favorite word processing 
program. Since there are international page size standards, they should be of¬ 
fered as choices in the program settings for the page size of your document. I’ve 
had to prepare presentations and manuscripts for courses and conferences in Eu¬ 
rope and Asia. If the standard page size formats were not made available to me 
in my word processing program, I would have no idea what was the appropriate 
page size to use for my international audience. As designers and developers, 
learn from these experiences and provide support for your users by giving them 
standard configurations and settings as choices in your interface. Your users will 
thank you for this thoughtfulness. 

Computer design standards are established by state and national govern¬ 
ment organizations, and also other national and international groups. Some of 
the more familiar standards organizations are the United States’ American Na¬ 
tional Standards Institute (ANSI), Germany's DIN, and the International Stan¬ 
dards Organization (ISO). 

Standards must be continually reviewed and updated. If not, they tend to 
freeze technology and stifle innovation. Many of today's standards don’t take full 
advantage of current computer hardware and software technologies. They also 
don't address all of the needs of computer users today. Many of our major com¬ 
puter hardware manufacturing and software development corporations are di¬ 
rectly involved in the international standards organizations. They usually have 
two goals: to help develop improved current and future standards, and to try to 
guide standards toward adopting their own product designs. 


User Interface Guidelines 


"The golden rule of design: Don't do onto others what others have 
done onto you. Remember the things you don’t like in the software 
interfaces you use. Then make sure you don't do the same things 
to users of the interfaces you design and develop ." 

Charlotte Schwendeman, 1991 
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Why are interface design guidelines needed? Shouldn't designers and pro¬ 
grammers be able to use the interface design principles I've just discussed to de¬ 
velop usable products? Unfortunately, interface design principles alone don't 
guarantee a usable and successful software interface. In fact, even following the 
guidelines covered in the software interface design guides doesn't guarantee a 
usable product. 

The principles discussed in the last chapter address all of the areas of the 
designer's iceberg chart. Guidelines, however, typically only address the look and 
feel of a product, that is, the presentation and interaction elements of the iceberg. 
Guidelines are simply rules and interpretations to follow for creating interface el¬ 
ements, their appearance, and their behaviors. Following interface design guide¬ 
lines without regard for users will probably result in a mismatched interface. 
You should not have a cookbook view of interface design, where guidelines are 
followed without regard to the quality of the ingredients and how they interact 
with each other. Blindly following any set of guidelines does not build you a us¬ 
able or consistent user interface. Gould (1988) said it well; "Most guidelines cen¬ 
ter on 'knob-ology' and have little to do with cognition and learning." 

Users should be familiar with interface design guidelines, in addition to 
general design principles, to help them understand interfaces and to evaluate the 
products they purchase and use. Designers should be very familiar with both de¬ 
sign principles and guidelines. They should be more concerned with following 
principles, as they are more closely related to designing interfaces with regard to 
the user. Programmers, on the other hand, are usually less concerned with prin¬ 
ciples and tend to use the guidelines as a reference on how to code the presenta¬ 
tion and interaction of interface elements (see examples in Figure 4-1). 

Some designers and programmers don't like to be forced to follow user in¬ 
terface guidelines because they believe that it stifles their user interface creativity. 
The IBM group that enforced the IBM Common User Access (CUA) user interface 
guidelines were unkindly referred to by some developers as the "CUA Cops" or 
the "Compliance Police." This caused unnecessary and unproductive contention 
between interface designers, programmers, and the compliance coordinators. 

However, most people see guidelines for what they are; aids to help design¬ 
ers and programmers do their job and enable them to build more consistent and 
usable interfaces. Guidelines are not meant to stifle interface design creativity. 
Designers and programmers should build usable and competitive products with 
interface features that meet interface guidelines. They don't always realize it, but 
they should even extend beyond the standard guidelines if needed for their 
product. This provides value-added new interface elements or interaction tech¬ 
niques that are meaningful and useful to users of a particular product. 
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Figure 4-1 . Some Controls Defined by CUA Guidelines, from IBM (1992a) 


The goals of all design guidelines are to allow users to transfer their knowl¬ 
edge of the interface within a product and across products they work with. This 
means that interface elements should work the same way when users see them in 
different parts of the same product and when elements appear in other products 
they use. 

Guidelines should also allow users to transfer their real-world knowledge to 
the interface. The interface should be consistent with real-world objects and 
metaphors. For example, if users see a set of buttons on the screen that look like 
buttons that set the stations on a radio, then their knowledge of how those but¬ 
tons work on the radio should allow them to correctly understand how the but¬ 
tons work in the computer interface. 


KEY IDEA! 


Interface guidelines are beginning to address pen, handwrit¬ 
ing gestures, and voice input, among other new computer technologies. One 
problem with developing guidelines for new technologies is that it is difficult to 
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define user interactions with technologies when users haven't interacted with 
them very much! That is why it takes some time to develop good guidelines. 
They should be based on user behavior over time, and it takes time for users to 
try out new interface technologies and figure out how best to use them. 


Where Should You Look for Interface Design Guidelines? 

The software design guides I referenced in the previous chapter on principles are 
the main source of design guidance for the major computing environments: 
Apple (Macintosh), IBM (OS/2, DOS), Microsoft (Windows), and UNIX 
(OSF/Motif). Bruce Tognazzini was the Human Interface Evangelist at Apple. 
His book. Tog on Interface (Tognazzini, 1992), is interesting interface reading and 
has an appendix of interface principles and guidelines. Smith and Mosier (1986) 
of the MITRE Corporation also publish a very complete set of user interface 
guidelines for general interface design. Edward Tufte, who helped with the 
graphic design of the OS/2 interface, has a very good book on the visual display 
of information (Tufte, 1983). 

Apple and IBM have published their guidelines for many years. Both sets of 
guidelines have recently been updated and republished. Apple's guidelines were 
originally published in 1985 as Human Interface Guidelines: The Apple Desktop In¬ 
terface in the Inside Macintosh series. The new guidelines (Apple, 1992), Macintosh 
Human Interface Guidelines are published in a large-sized, easy-to-read book with 
more graphics and examples. There’s also a handy CUA Tips and Techniques pub¬ 
lication available from IBM (IBM, 1992b). Let's take a closer look at the IBM and 
Microsoft design guides. This is a peek into the relationship between Microsoft 
and IBM in the user interface area. 


The GUI-OOUI Divorce: CUA Guidelines 

Just as the development history of the DOS and OS/2 involved both Microsoft 
and IBM, so did the development of the user interface underlying both operating 
systems. IBM (1989) first introduced the concept of the workplace environment as 
an extension to the graphical model of CUA 1989: "The workplace environment 
describes the integration of applications into an electronic version of a working 
environment that simulates a real workplace. For example, an electronic work¬ 
place for the office would have mail baskets, file cabinets, telephones, and print¬ 
ers that all applications could share. The separate applications are integrated as 
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objects that appear as icons in the workplace environment." This information 
was provided by IBM to help designers, programmers, and users prepare for the 
natural evolution of the CUA interface. 

The object-oriented workplace environment is fully documented in IBM 
(1992a). Microsoft user interface engineers were initially involved in this work 
but dropped out as Microsoft steered away from OS/2 back to the Windows 
graphical environment. The OS/2 2.0 and OS/2 2.1 products implement the 
workplace environment of the CUA user interface guidelines. This is only the 
beginning of the OOUI revolution. IBM is already working on the next iteration 
of the CUA object-oriented interface guidelines, which will be made available 
sometime in early 1994. 

The evolution of the CUA interface architecture and its implementation in 
the OS/2 Workplace Shell are covered in depth in two articles of a 1992 IBM Sys¬ 
tems Journal. Dick Berry (1992), affectionately known as the "Father of CUA", 
wrote a detailed discussion of the designer's model of the CUA Workplace. Berry 
and Reeves (1992) discuss the evolution of CUA's interface. 

The goals of the object-oriented CUA user interface are straightforward: al¬ 
low users access to their data and information, anywhere in the system, in any 
form, and provide a user interface that empowers and excites people. A 
well-designed object-oriented interface allows typical users to focus on their 
tasks. They need not be aware of applications, system programs, and program¬ 
ming concepts. 

IBM's Common User Access (CUA) guidelines were first externally pub¬ 
lished in 1987 as one book that covered both the host environment 
(nonprogrammable terminals, or NPT) and the personal computer environment 
(programmable workstations, or PWS). In 1989, IBM updated the interface archi¬ 
tecture and split the CUA guidelines for these different environments into two 
books. Guidelines for the NPT environment were covered in the Basic Interface 
Design Guide (IBM, 1989). These guidelines are still valid and are available from 
IBM. The CUA 1989 Advanced Interface Design Guide covered application-oriented 
interfaces and introduced the object-oriented workplace environment. 

The CUA 1991 object-oriented user interface design and reference guides 
replaced the CUA 1989 PWS guide. The CUA 1991 book was also republished 
commercially (IBM, 1992a) to get the guide better access to the general develop¬ 
ment community. Figure 4-2 shows the evolution of the CUA user interface ar¬ 
chitecture design guides. Are you confused yet? Still trying to figure out what's 
the latest set of guidelines you should be following, and for which programming 
environment? Well, just wait, it gets crazier! 
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Figure 4-2. Evolution of the IBM CUA Interface Design Guides 


Until 1991, Microsoft and IBM worked together closely on a strategy that 
positioned Microsoft's Windows operating system as a stepping stone in the mi¬ 
gration path to OS/2. While I was an IBM CUA interface architect, Microsoft's 
interface designers worked with us as we defined the CUA 1991 user interface 
architecture and wrote the CUA guidelines. These guidelines were developed for 
both the DOS/Windows and the OS/2 environment. Microsoft even shipped the 
IBM CUA 1989 Advanced Interface Design Guide as part of the Windows 3.0 Soft¬ 
ware Development Kit. As the two corporation's software strategies began to 
drift apart, so did Microsoft's involvement with the CUA 1991 effort. Microsoft 
kept shipping the CUA guidelines with the Windows toolkit until 1992. At that 
time, however, Microsoft finalized the divorce by publishing their own set of 
guidelines (Microsoft, 1992). 

Windows developers, already using the CUA guidelines shipped with the 
Windows Development Kit, suddenly had a new set of guidelines to follow. 
Windows developers couldn't build the CUA 1991 object-oriented interfaces with 
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the Windows interface environment. Microsoft didn't want to continue to use 
IBM's CUA 1989 guidelines, or use the CUA 1991 application-oriented guidelines 
while OS/2 2.0 designers and programmers migrated to the object-oriented CUA 
1991 environment. So they wrote their own set of graphical interface guidelines. 
In the book's introduction, Microsoft explains this shift in design guides, "These 
guidelines were developed to be generally compatible with guidelines that may 
be appropriately applied from the IBM Common User Access (CUA) version 2.0 
definition, published in IBM Common User Access: Advanced Interface Design Guide 
(Boca Raton, FL: IBM, 1989); but they are not intended to describe user interface 
requirements for CUA compliance." 

This is just one of the interface skirmishes in the history of the GUI-OOUI 
war between Microsoft and IBM. Keep reading, there's more! In later chapters I'll 
go into great detail on the GUI-OOUI war and describe the interfaces themselves. 


How You Can Benefit from Guidelines: Style Guides 

"There are increasing numbers of guidelines, reflecting the 
increasing numbers of people designing and using computer systems. 
The continuing effort to produce more and better guidelines reflects 
how difficult it is to design systems from guidelines. Design is a series 
of trade-offs, a series of conflicts among good principles, and these 
concepts are hard to incorporate into guidelines." 

John Gould, 1988 


In addition to providing designers and programmers with guidance on user in¬ 
terface design and implementation, guidelines provide a number of additional 
benefits if they are properly utilized. If you are developing more than one soft¬ 
ware product, or products on multiple platforms, these guidelines should help 
the interface design efforts not only for the single product, but should also apply 
across a range of similar products, and across platforms. 

A high-level benefit of following guidelines is that a common user interface 
specification, or style guide , can help ensure that similar products and services 
have similar interfaces. Developing a style guide can also simplify and improve 
the product development process. Interface elements and dialogs can be reused 
and shared between programs. Usability testing results on interface elements and 
techniques can be generalized, and design decisions based on human factors test- 
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ing can be applied across the range of products. A style guide can also serve to 
focus efforts to define, test, and implement new key interface technologies and 
techniques. They can then be applied quickly and consistently in the products cov¬ 
ered by the interface style guide. 

Style guides not only contain the guidelines critical to common interface de¬ 
sign efforts. They should also contain visual presentation styles and interaction 
techniques that are not necessarily addressed or specified by general guidelines. 
For example, where does the user's logon dialog appear on the screen and how 
should the data entry fields be organized in the dialog? What is the color and 
font scheme for static or variable text on a background color in a window? How 
are the function keys mapped onto user actions? What actions happen when the 
mouse buttons are pressed? These stylistic and functional attributes must be 
specified and documented so they can be consistently implemented. 

Here are some simple steps to help you benefit from the years of experience, 
skill, and testing that have gone into design guidelines. These steps should get 
you started in the right direction with consistent and usable interface design. 
Berst (1993) discusses these steps and I've paraphrased them as follows: 

• Get the appropriate guidelines for your software environment. 

• Create a company style guide for your own product interfaces. 

• Pick a target application to follow that uses those guidelines. 

• Follow the guidelines when developing your own applications. 

• Follow the guidelines when shopping for software products. 

When developing a style guide for your development projects, make sure 
that your work efforts are realistic. That is, make sure that your interface goals 
and guidelines are achievable with the skills, computing environment, and what¬ 
ever tools are available. You must also work within the business constraints of 
your developers and users. Your interface guidelines and goals must also be 
testable. There is no point in developing a company style guide if you can't test 
the resulting interfaces to see if product and interface usability goals are met. A 
style guide must be well-documented and made available to designers and pro¬ 
grammers, and there must be development support for adhering to the guide¬ 
lines. Remember, the responsibility for developing a usable and consistent inter¬ 
face belongs to the design and development teams. Take this responsibility 
seriously and your users will thank you later. 
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The Problem with Guidelines: Do They Work? 

"Designers striving for user interface consistency can resemble 
Supreme Court justices trying to define pornography: each 
of us feels we know it when we see it, but people often disagree 
and a precise definition remains elusive. A close examination 
suggests that consistency is an unreliable guide and designers 
would often do better to focus on users' work environments." 

Jonathan Grudin, 1989 


While I have been proposing that user interface consistency is one of the highest 
goals for user interface design, there are arguments that this is an unobtainable 
and unreliable goal to try to achieve (Grudin, 1989). The main problem is that 
consistency is very difficult to identify, define, and implement. In addition, inter¬ 
face consistency may not even be an appropriate goal. Grudin proposes that, 
"When user interface consistency becomes our primary concern, our attention is 
directed away from its proper focus: users and their work." System and interface 
consistency can sometimes conflict with the consistency that users expect and 
want. I hope that you won't forget all you've read in the previous chapters about 
the importance of understanding the human abilities and limitations of your us¬ 
ers and knowing how they do their work. 

Another major problem with user interface guidelines is that there is always 
a substantial amount of interpretation involved with implementing guidelines in 
an actual product interface. No matter how detailed they are, I have yet to see a 
set of guidelines implemented in an interface without some element or behavior 
being different from the way "it was intended it to be." Interface guidelines are 
not, and never will be, a cookbook for software design. 

IBM researchers have studied how designers use guidelines to design inter¬ 
faces. One particular study was conducted as a critical part of the development of 
the IBM CUA 1991 user interface guide and reference books. Tetzlaff and 
Schwartz (1991) asked designers to build compliant interfaces based on drafts of 
the CUA interface guidelines. They found that the designers missed several 
critical concepts and details. Designers preferred graphic illustrations and ex¬ 
amples rather than text for learning design concepts and wanted to be able to 
explore the examples interactively. Although their final designs were judged to 
be largely compliant, there were differences in interpretations of the guidelines. 
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Interface design is like many other areas of our lives; there isn't always one right 
answer to a particular question. 

Another study (Thovtrup and Nielsen, 1991) found very similar results. 
Only 71% of their participant's designs were compliant with the design standard 
they were given. Most of the differences were due to influences from designer's 
experiences with nonstandard interface designs. They also showed that it is dif¬ 
ficult to evaluate interface designs for compliance. When given an interface to 
evaluate, designers only found an average of 4 out of 12 deviations in the designs. 
This was especially surprising, since the test participants had expressed an 
above-average interest in interface usability. 


KEY IDEA! 


These studies reinforce my point that interface design is more 
of an art than a science. We might have to revise the opening quote for this chap¬ 
ter to "I can't tell you what I want, and I won't even know it when I see it." Let's 
draw some conclusions now. Concrete examples are extremely useful for sup¬ 
porting design guidelines. Tools are necessary for supporting compliant interface 
design (more on tools in a few pages). Education and training may also be 
needed to enlighten designers and programmers to the design principles and 
guidelines they should be following. 


Ultimately, even with all of these principles and guidelines at hand, there is 
no guarantee of a usable interface. One of the worst things that can happen is for 
designers and developers to think that since they followed the guidelines, they 
have a compliant, usable interface. Therefore they don't need to do any usability 
testing on the product interface. This is not the case! I'll talk more about usability 
testing in the interface design process in the next chapter and will discuss usabil¬ 
ity test results in later chapters. 

Even after all these problems I've discussed about interface guidelines, it is 
still generally agreed that it is better to use accepted interface design principles 
and guidelines then not to use them. Alan Zeichick (1991) summarized this dis¬ 
cussion well, "The moral: follow existing user interface guidelines when devel¬ 
oping programming tools and consumer products. Follow them even if you think 
the guidelines are flawed. Perhaps your design is superior, but ask yourself: will 
this superior function-key mapping scheme or improved menuing metaphor help 
my application become a seamless part of the user's working environment? Or 
will it be a continual annoyance, helping turn my perfect product into shelfware?" 
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What Do Guidelines Look Like? 


"Be obscure clearly. 

An Old Proverb 


Guidelines generally fall into three areas of user interface design: physical, syn¬ 
tactic, and semantic. The goal is to achieve consistency across all of these areas. 
The physical area applies to the hardware portion of the user interface. This in¬ 
cludes devices used to input data, such as the keyboard, mouse, trackball, and 
touch screen. These guidelines address topics such as the location of keys, the 
layout and design of keys on the keyboard, and how the mouse is used. For ex¬ 
ample, CUA guidelines define mouse button 1 as the selection button and mouse 
button 2 as the direct manipulation button. 

Syntactic guidelines refer to rules about presenting information on the screen 
and the sequence and order of user actions. For example, to print a document us¬ 
ing direct manipulation, you must first drag the icon for the document and then 
drop it on the printer icon. This is the correct sequence of actions. Dragging the 
printer icon and dropping it on the document icon is not a valid action. 

The third area covered by guidelines is the semantic aspect of user interfaces. 
This refers to the meaning of elements, objects, and actions that make up a part of 
the interface. For example, the term Exit has a certain meaning to users and it 
performs a certain action that is expected by users. This is very different from the 
meaning and expected action for the term Cancel. Exit finishes the interaction 
with a dialog and usually leaves the program completely. Cancel, meanwhile, 
usually stops any pending actions and backs up one step from the dialog. 

Guidelines are usually classified by how important or critical they are to the 
user interface. Figure 4-3 shows a sample page from the CUA 1991 Design Refer¬ 
ence. Each guideline has a "When to Use" and a "How to Use" section. Items 
with a check mark in the check box are required (critical) guidelines that must be 
followed to maintain consistency with the overall design goals and the CUA in¬ 
terface. Items that are not checked are still important to creating consistent inter¬ 
faces, but are not essential. Designers should follow all of the required guidelines 
to establish a basic level of consistency in an interface. Decisions to implement 
optional guidelines should depend on individual or corporate style interpreta¬ 
tions, development schedules, resources, and development budgets. 

You may wish to extend an interface beyond the guidelines. You may be 
creating an interface element that does not exist or you may wish to modify an 
existing element to improve its usability. The Apple guidelines offer these sug¬ 
gestions in this area: build on the existing interface, don't assign new behaviors 
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CUA interface components 
are listed in alphabetic order 
in this book. 


A technical definition is 
provided for each component. 


Graphical representations 
of the CUA interface component 
are included for your 
reference. These graphical 
representations are examples 
only, and are not intended 
to define how a component 
should appear in your 
interface. | 


Items listed under 
"When to Use" provide 
direction on the 
circumstances under 
which a component 
should be used. 


Items listed under 
"Guidelines" provide 
direction on howto 
use a component. 


Component 

This is the definition of th< 

1 - 

; CUA-interface component. 

; s y Jartuay News - Layout Q .o 


Document Selected Edit View Windows Help |j 


HI 



When to Use 


0^ This item ensures a consistent, predictable, 
and forgiving user interface 


— Guidelines 

□ This item can further enhance the interface and 
could give your product a competitive edge. 

_ Essential Related Topics 

• See "Keyboard," page 98. 

r Supplemental Related Topics 

• See "Menu," page 145. 


Items listed under - 

"Essential Related Topics" 
should be read to understand 
the use and interaction of 
a component. 


Items listed under - 

"Supplemental Related Topics" 
are additional components that may 
be of interest but are not critical to 
understanding the component. 


Empty-check-box statements, 
( □ ) while not essential to 
creating an interface 
consistent with CUA 
guidelines, will increase the 
overall ease-of-use of 
your product. 


Filled-check-box statements 
( 0^) are considered to be 
essential to creating an 
interface that will be seen 
by users as being consistent 
with the CUA guidelines 
and its underlying principles. 


Figure 4-3. CUA Reference Page Example, from IBM, 1992a 


to existing objects, and create new interface elements cautiously. Also, any de¬ 
viations from the guidelines should only be done if there are usability test results 
that justify departing from the guidelines. 

Figure 4-3 shows the types of interface controls that are addressed by the 
CUA design guide. The other interface guides address these types of interface 
elements as well. The guidelines for each interface element or control tell de¬ 
signers and programmers: when to use them, how to present them, and what 
techniques should be used (such as keyboard sequences or mouse actions) to in¬ 
teract with the interface elements. A complete set of guidelines covers every ob- 
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ject and element of the interface in terms of its presentation on the screen, its be¬ 
haviors, and the techniques users have available to interact with them. 


Color Guidelines 

"Of all design elements, color most exemplifies the 
wholeness of design, the necessity to reason globally." 

Edward Tufte, 1992 


Our knowledge of the human visual and perceptual system leads us to develop 
some very important fundamental guidelines for the use of color, regardless of 
the media in which the information is presented. These guidelines apply to the 
use of color in printed materials, broadcast media, and on computer displays. 
Before I list some guidelines and their references, here are a few examples. 

Color is often used in a qualitative way, to represent differences, but can also 
be used in a quantitative way, to show amounts (Murch, 1984). Take a closer look 
at the weather page of your local newspaper or the "Weather Across the USA" 
page of USA Today. Colors are used to show different temperature zones across 
the map. They range from light to dark to show the range of temperatures from 
cold to hot. Colors are extremely useful in adding additional meaning to the pre¬ 
sentation of information. Colors are even useful in the plant world. When I was 
at Epcot Center in Orlando, Florida, the tour guide pointed out different colored 
sticky-papers that were used to attract and kill bugs that were eating the plants. 
The different colors attracted different types of bugs. 

Since color is such an automatic attention-getting mechanism, lots of color in 
an interface will cause users to pay attention to the screen. This helps make a user 
interface seem somehow friendlier and easier to use. However, this "Las Vegas" 
effect, as I discussed in Chapter 1, can actually distract users from their tasks. 

Edward Tufte, an expert in graphic design, helped design the user interface 
color schemes for the new IBM OS/2 interface. If users don't like the default col¬ 
ors used in the OS/2 interface, they can customize the color of any particular el¬ 
ement. OS/2 provides an additional utility that is extremely useful-a color 
scheme palette-where users are given different sets of color schemes that have 
already been developed by graphics design experts. Users can switch color pal¬ 
ettes, modify the existing palettes, or create their own color schemes. This is an 
incredibly powerful utility, yet it is amazingly simple for people to use (see Figure 
4-4). Similarly, there is also a font palette, where users can immediately change 
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Figure 4-4. OS/2 Color, Font, and Scheme Palettes”' 


the font style, size of text, icons, and window title names. This is very helpful for 
users with different visual abilities, working conditions, and for different types of 
computer displays. 

Tufte (1992) reiterates one of the main principles in using color: "Above all, 
do no harm." This relates directly to the Las Vegas effect. In a windowed user 
interface environment such as Windows and OS/2, users must be able to quickly 
and easily find the window that is currently active. You would think that a wide 
window border and a bright, obvious color might be best used to highlight the 
active window. Window borders do present some information, but again, too 
much attention on the window border takes users' focus and attention away from 
where the most important information is, inside the window ! So, a window border 
doesn't need to be overly wide. This takes up valuable screen space and detracts 
from the presentation of the important information. 


110 


The GUI-OOUI War: 


Windows vs. OS/2 












The same applies to color used to highlight the active window. Tufte de¬ 
termined that the color of the active window border should be light in value to 
avoid interacting with other window borders, and should be a deeply saturated 
color, to provide a conspicuous, yet not distracting, signal. He concludes, "Yellow 
is the only color jointly satisfying those conditions, and therefore proves valuable 
for bordering windows. Inactive areas are grayed down, calming the background 
surrounding the active window." Thus, the now well-known "golden window" 
was born. Most people, including many interface designers, don't know or un¬ 
derstand the depth and complexity of the graphics and color design and testing 
history that lie behind the user interface of a successful product. 

In fact, some users and critics complain that the colors on the OS/2 interface 
are too subtle or bland. What do you think? After reading the earlier chapter on 
perception and color, go take a look at your computer screen. Now look at other 
computer screens around you in the office. Count how many colors are used in 
your operating system and product interfaces and then see whether the colors are 
used to present meaningful information to you as a user or if they are used just to 
brighten up the interface. Of course, color preferences vary greatly from person 
to person, so operating systems and products allow users to customize back¬ 
ground colors, patterns and images. You can also change the colors, fonts and 
other features of many user interface elements. I am constantly amazed at the 
awful color combinations I see on computer screens as I walk around in the office! 
It's as if people are trying to win first place in an "ugly screen" contest! OS/2’s 
desktop was designed to work best for the user's perceptual well-being. 

Murch (1984) is a well-respected source of research on the psychological and 
physical aspects of color. Here are his ten fundamental guidelines for the proper 
use of color on computer displays. I won't go into any greater detail here, but all 
of these guidelines are based on years of research and our understanding of hu¬ 
man color vision and perception. As Murch states, "It is impossible to develop a 
complete set of guidelines for the effective use of color in all applications. We can, 
however, establish some broad principles based on the mechanisms of human 
color perception." 

1. Avoid displaying highly saturated, spectrally extreme colors together. 

2. Saturated blue should be avoided for text, thin lines, and small shapes. 

3. Avoid adjacent colors that differ only in the amount of blue. 

4. Older operators need higher brightness levels to distinguish colors. 

5. Colors change in appearance as the ambient light level changes. 

6. The magnitude of a detectable change in color varies across the spec¬ 
trum. 
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7. 


It is difficult to focus upon edges created by color alone. 

8. Avoid red and green in the periphery of large-scale displays. 

9. Opponent colors go well together (red-green or yellow-blue). 

10. For color-deficient observers, avoid single-color distinctions. 

Here’s one final source of design guidance on color. Aaron Marcus is a 
well-known interface designer and consultant in the computer industry with a 
background in information and graphic design. His ’’Ten Commandments of 
Color” (Marcus, 1986) are a good list of guidelines, in addition to Murch’s list. 

1. Use a maximum of five, plus or minus two, colors. 

2. Use foveal (center) and peripheral colors appropriately. (Use red and 
green in the center of the visual field. Blue is good for slide and screen 
background and borders.) 

3. Use colors that exhibit a minimum shift in color/size if the colors 
change in size in the imagery. 

4. Do not use high-chroma, spectrally extreme colors simultaneously. 

5. Use familiar, consistent color codings with appropriate references. 

6. Use the same color for grouping related elements. 

7. Use the same color code for training, testing, application, and publica¬ 
tion. 

8. Use high-value, high-saturation colors to draw attention. 

9. If possible, use redundant coding of shape as well as color. 

10. Use color to enhance black-and-white information. 

Tests show that color can be effectively used to improve performance. One 
study (Widjaja, 1992) assessed program debugging performance by three groups 
of developers given three different color-coding schemes: 1. black-and-white, 2. 
color groupings that arranged loops and nested structures in five shades of green, 
and 3. color-flagging that highlighted potential error areas in orange. Their re¬ 
search suggested that the color-coding substantially improved error detections in 
C-language programs. Many studies similar to this one have shown the effec¬ 
tiveness of using color to highlight information. 

Here's one final thought on using color. Learn from our years 
of experience in using color in printed materials. Printing costs increase dra¬ 
matically with each color that is added to any black-and-white material. There¬ 
fore, designers use color very carefully to add value where needed and do so only 
when the added value justifies the additional printing costs. User interface de- 
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signers should utilize colors in the interface with the same care and frugality as if 
each color had to be cost-justified. Just because the computer display may be ca¬ 
pable of showing 256 or more colors, it doesn't mean designers should try to use 
as many colors as possible. A good idea is to design the user interface first in 
black-and-white and then add color later, and only where needed. 


Designing Interfaces for World-Wide Use 

All of the design guides and software corporations I've mentioned recognize that 
the world of software development and interface design is an international one. 
Any software product developed today has a potentially large audience of users 
and developers from different countries, languages, and cultures around the 
world. This area is called internationalization, or National Language Support (NLS). 
It is a key factor for the worldwide success of software products. 

Today's programming and interface tools allow much of what the user sees 
and interacts with on the screen to be separated (soft-coded) from the rest of the 
program (hardcoded information). This allows users and developers to use and 
customize the program in different languages with very little effort. By separat¬ 
ing all information such as text, symbols, and icons from the system code, you 
ensure easier access for both translators and users. 

There are many areas of an interface that require additional consideration for 
national language support. Think of all of the different monetary currencies in 
the world. A few United States dollars may be presented on the screen in only a 
few characters, such as $9.23. This same dollar value may be equal to several 
million Italian lira, which takes up quite a bit more screen space as L.2,450,000.58. 
An entry field for input of monetary data must be large enough to accept all the 
different national monetary amounts. How much screen space do you need for 
translating text? Translating text from English to other languages typically re¬ 
quires from 30% up to 100% additional screen space. What about the different date 
formats around the world? How do you ensure that your program will be usable 
in different nations and cultures? 

Most of the major design guides offer advice for developing interfaces for 
the international audience. Figure 4-5 lists some of the areas that must be ad¬ 
dressed for international design. How many of these areas would you have 
thought of by yourself if you were asked to develop an international version of a 
software product? 

A true test of a well-designed international product is when users can switch 
from one language to another and still understand how to use the program. Fig- 
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- Capitalization 

- Double-byte character sets 

- Column headings 

- Date formats 


- Descriptive test 

- Time formats 


- Field preempts 

- Measurement formats 


- First letferxursor navigation 

- Currency formats 


- Icon design 

- Numeric formats 


- Use of symbols 

- Separator formats 


- Length of text 

- Telephone number formats 

- Shortcut keys 

- Paper size formats 


- Keyboard combination 

- Address formats 


- Function key assignments 

- Acronyms 


- Sorting information 

- Abbreviations 


- Mnemonic selection 

- Humor 


- Bidirectional languages 

- Grammatical person and voice 


Figure 4-5. Areas of Concern for International Interfaces 


ure 4-6 shows the sandwich program in three different languages, French, Ger¬ 
man, and English. With very little work the programmer was able to build the 
program to support multiple languages. 

Here's another multicultural example. In 1988, I taught a user interface de¬ 
sign course at the IBM Yamato Laboratory in Tokyo, Japan. I normally give stu¬ 
dents in my course a copy of the IBM CUA user interface guidelines. When I 
asked the Tokyo course coordination if I should send copies of the books for the 
students, I was told that the books had already been translated into Japanese and 
students would be given a copy of those books. Amazingly, the Japanese books 
were printed in exactly the same format as the English version, so I could still use 
my own book to point to a particular paragraph or illustration on a page and it 
was on the same page in their book. How's that for consistent presentation of in¬ 
formation across cultures and languages? 

The CUA 1989 design books included a sample program developed to dem¬ 
onstrate the guidelines. This program was also translated into Japanese. When I 
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Figure 4-6. Sandwich Program in English, French, and German 


got to Tokyo to teach the class, I had to use the Japanese version of the program 
that was already installed on the classroom computer. I was amazed and relieved 
to find that I could use the demo program to explain interface objects, elements, 
and interaction techniques without understanding a word of text on the screenl Be¬ 
cause I knew how the interface looked and worked, I didn't need to be able to read 
the screen text. I couldn't even read the key labels on the Japanese computer 
keyboard. For example, the Exit choice on the File menu was still in exactly the 
same place I was used to and it performed exactly the same action. This shows 
how following physical, syntactic, and semantic guidelines allows users to main¬ 
tain consistency between a program they are familiar with and a similar program 
whose content may be unfamiliar or even unreadable. 
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Guidelines and Software Development Tools 

"A graphic end-user environment demands a graphic development tool. 

Object-oriented tools are often recommended because of their natural 
fit with the visible objects on the graphical-interface screen." 

Peter Coffee, 1992 

In Chapter 6 I'll look at the software technology cycle and how it affects the on¬ 
going development of new and improved products and tools. This is critical to 
the design, prototyping, and development of state-of-the-art user interfaces. Very 
few programmers today code systems and programs totally in a low-level lan¬ 
guage. Developers typically use a programming language and, additionally, 
some type of application generator or interface builder tools to help design and 
code common user interface elements and objects. These interface dialogs and 
"widgets" make up a collection of building blocks from which related products 
can be built. 

As software operating systems and user interface techniques evolve, the key 
development tools must keep pace with them. For example, product developers 
(and also their users) shouldn't accept a user interface for a new product on the 
OS/2 2.1 platform that was designed according to the outdated IBM CUA 1989 
guidelines. Tools that are successful today in the OS/2 2.1 environment are ones 
that will allow interfaces to be designed according to the CUA 1991 user interface 
guidelines. 


KEY IDEA! 


The IBM CUA interface architecture group is already working 
on the CUA 1993-94 guidelines, which will further evolve the object-oriented in¬ 
terface architecture on which OS/2's Workplace Shell is based. After the new in¬ 
terface guidelines are made available, tool vendors will be moving quickly to in¬ 
clude the new elements and techniques from the new CUA architecture in their 
tools. New interface technologies are always forcing new and better tools to be 
developed. Users, designers, and developers are always looking for better and 
easier ways to do their jobs. Over 50% of the developers in the Thovtrup and 
Nielsen (1991) study complained that their programming tools were not sufficient 
for supporting the user interface requirements made by the guidelines. 


How do you choose the proper development tools for products developed 
for you and your company or products you develop for sale? One key factor is a 
tool's ability to enable or enforce the current user interface guidelines for your 
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software environment. There are two questions to ask. One, does the tool enable 
you to develop a robust user interface? Two, does the tool enforce the appropriate 
interface guidelines during development? These are very different questions and 
their relative importance depends on your own priorities as a designer, pro¬ 
grammer, or those of your audience. 

You are probably interested in developing interfaces that follow the basic 
guidelines. However, if you are more concerned about enhancing or evolving in¬ 
terface elements beyond just the standard interface, you will want a tool that does 
more enabling than enforcing. 

If you want to build an interface that is similar to and consistent with other 
program interfaces on your system, then you may be more interested in tools that 
will enforce the guidelines. These tools will help you build consistent and familiar 
interfaces. Some tools even allow you to choose the "enforcement mode" you 
want to work with. In "lenient enforcement" mode, the tool will simply tell you if 
you build something that deviates from the guidelines. In "strict enforcement" 
mode, the tool won't let you build an element or technique that deviates from the 
established guideline. Now that is a customized development environment! 

The range of development tools covers a wide spectrum of program and in¬ 
terface development from building graphical front-ends to host programs or da¬ 
tabases, to building totally object-oriented programs and interfaces using the lat¬ 
est OOP (Object-Oriented Programming) technology. Because of this wide scope 
of tools applicability, it is a major decision to choose the appropriate tool to meet 
your business needs and to meet your customer and user product and interface 
demands. 

I won't attempt to tell you which are the best tools to use. The best advice is 
to take time and seriously research what tools are being used by your business 
colleagues and competitors. There are many developer symposiums, business 
shows, training seminars, and consultants available on all of the major software 
development platforms. Use these resources to help you reach the correct deci¬ 
sions regarding what turns out to be a major part of your development effort- 
your application, and interface, design, and development tools. 

One last point about tools. Some tools are very easy-to-learn and use and 
can build sample programs very quickly. They can be used to design interface al¬ 
ternatives, marketing demos, and are also extremely valuable for early testing 
scenarios. These types of tools are called prototyping tools. Their good points are 
that they aren't too expensive and are usually designed to be used by nonpro¬ 
grammers to develop "quick and dirty" interfaces. You shouldn't need a team of 
programmers to build your demos. However, the bad news is that most of the 
time the end result of using these prototyping tools is what we call "throwaway" 
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code, since it usually can't be used to develop the final product. These tools may 
be used for simple applications, but usually won’t stand up to heavy use. 

The other types of tool are development tools. Their advantage is that they 
will help you build industrial-strength systems and programs. However, these 
tools usually require a significant amount of programming skill and specific 
training on the tool. These tools are usually called application or program gen¬ 
erators and are quite expensive, but almost necessary, for company-wide or 
commercial development projects. 

The history and evolution of prototyping and development tools has swung 
like a pendulum. In the late 1980s, prototyping tools were the rage, but then 
seemed to fade out in favor of major development tools in the early 1990s. Now, 
as object-oriented technologies begin to infiltrate the tools environment, the trend 
seems to be swinging back toward easier-to-use tools. The major tool developers 
are beginning to realize that their customers want tools that are easy to use for 
both programmers and nonprogrammers. Tools must be capable of building 
simple programs quite quickly and also large-scale projects that require more skill 
and effort. Hopefully you’ll get a chance to use some of these tools in your design 
and development work. 


Usability Is More Than Standards and Guidelines 

Standards are really building blocks on which designers and 
programmers can base their development efforts. However, just because these 
standards exist, doesn't mean that every house built according to construction 
standards is a well-designed, livable home. Nor is every hardware or software 
product usable or enjoyable because standards were followed. Gould (1988) 
notes, "However, beyond being good starting points, standards provide little help 
in designing a system.” So, please remember the importance of the other chapters 
in this book. Standards will never replace user interface design principles, guide¬ 
lines, and a thorough understanding of your users. 
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FIVE 


The Interface 
Design Process 


"It's like the well-known answer 
given when someone asks why a 
piece of property is so valuable: 
'Location, location, location.' 
For a successful interface design 
process, the answer is 'Iteration, 
iteration, iteration." 


Theo Mandel, 1993 




Just as following design principles, guidelines, and standards doesn't guarantee 
a usable interface, there is no magic design and development process that can 
guarantee a successful product. The type of interface design process you follow 
should be tailored to your particular business and environment. A large company 
may have separate departments devoted to each area of the development process. 
Other organizations may rely on only one person or a few individuals. Regardless 
of the size of your organization, you should follow a design team approach. No 
one department or individual typically has all of the skills to do all of the required 
steps in the process. 

For example, does your group have the skills to gather user requirements? 
Do you have usability testing expertise available? Do you have a graphics de¬ 
signer on staff? If you or your company don't have all the skills to complete the 
development process, there are many consultants and companies that can help 
with any and all aspects of your design and development. A user interface design 
and development team should theoretically include people with training in psy¬ 
chology, graphic design, visual communication, fine arts, journalism, video, 
learning theory, engineering, and computer science. 

Developing the user interface may or may not be a separate process from the 
rest of a product. The stages I'll discuss apply to developing both the interface 
and the program code. Figure 5-1 shows a development process followed by the 
CUA interface architects to design a sample product interface. This interface and 
the process they followed to create it were used as a case study in the CUA 1991 
design guide. 


KEY IDEA! 


Any successful user interface design process must be an itera¬ 
tive process. If that term is not familiar to you, the best description I could find is 
the one in Webster's Dictionary. It defines iterative as, "Relating to or being a 
computational procedure in which replication of a cycle of operations produces 
results which approximate the desired result more and more closely." In simple 
terms, this means that you really can’t produce a well-designed interface without 
going back and checking with your users periodically. This includes both gather¬ 
ing their requirements and testing the interface with users. The bottom line is 
that developers must take the time to find out what users need and they must be 
committed to providing the best user interface that gives users what they want 
and what they need. Let's briefly walk through the major components of this 
process (Figure 5-1). 
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'We need to do a better job of thinking about technology from the point 
of view of all individuals-how they work, how they think, what they 
need to work and think more effectively." 


Bill Gates, 1990 


Here's where you must start-with your users. First, define the problem custom¬ 
ers or users want solved. Learn about your users' capabilities and the tasks that 
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they perform. Don't just talk to executives and managers. Watch and learn from 
the actual users of your programs. Notice the hardware and software constraints 
of their computer systems and work within these constraints. Your solution must 
satisfy the needs of the actual users and the managers who approve the purchas¬ 
ing of programs and oversee their work. 

The iterative development process includes returning to the research and 
planning stage to see if your audience needs and requirements change during the 
development process. I've been involved with product development efforts 
where the user's environment, and consequently, their requirements, changed 
drastically during our product development process. If we hadn't gone back and 
worked with users during the process, we might have built a good product, but it 
wouldn't have met users' current or future needs. It would only have met their 
past needs. 

There are some key questions you need to ask during your field research. If 
you don't know the answers to these questions, don't assume that you, your de¬ 
sign and development team, or your marketing folks really know the answers. 
The only way to find the answers is to observe users and ask them questions. 
Here are the important questions: 

• Who are the users? 

• What are their experiences and skills? 

• What are their goals in performing the tasks? 

• What sources of information do they use in their tasks? 

® How do they do their work? 

• What information do they generate during their work? 

• What are the interaction techniques they use? 

• What are the core technologies they require? 

• How much are users and managers willing to pay for a product? 

• Who installs the products? 

• Who supports the products, once they are installed? 


124 


The GUI-OOUI War: Windows vs. OS/2 




Design the Interface 


"On the order of 70 percent of product cost is spent on design of the user 
interface. If the manufacturer of the platform provides a GUI toolkit, 
developers can reduce those costs to ideally around 25 to 30 percent 
and design a better product. The developer wins twice." 

Bill Buxton, 1991 


Specific design goals must be defined in behavioral and performance terms that 
can be measured by testing. Next, develop a series of user scenarios. Remember, 
this is not a onetime design effort. Through the iterative process, you will be re¬ 
designing interface elements that you have already designed and you will be de¬ 
signing new pieces of the interface. 

Continually incorporate changes until you have met and succeeded the de¬ 
fined interface goals, or if you have reached a critical development deadline. 
Always keep users in mind when you reach critical design checkpoints. You 
must have a user interface designer involved who can be an advocate for the user 
audience during the design process. 

Based on many factors, you must build an interface that meets the needs of 
your users. Do they want and need a GUI or an OOUI? Or, is it appropriate to 
build them a command-line interface? Users may need to use all of the interface 
styles I've mentioned. I'll answer all of these interface style questions in the fol¬ 
lowing chapters. 


Prototype and Build the Interface 


"It is simply not possible to design a competitive user interface these days 
without powerful prototyping tools right from the start." 

Edward Tufte, 1992 


The Interface Design Process 
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I've already discussed how prototyping and development tools can be used to 
help enable and enforce interface design. You may start out with hand-drawn 
paper versions of the interface for early in-house testing or even more formal user 
testing. 

Many developers today actually use a prototype of the product in place 
of what is normally a lengthy written document, the Product Functional Specifica¬ 
tion (PFS). It is very difficult to write about the presentation and interaction 
techniques involved in graphical user interfaces. It is much easier and much 
more effective to develop a prototype, or demo, of the product interface. You will 
find that this demo can also serve as a marketing and promotion aid to show 
managers, executives, and customers. A demo of the finished product is also a 
great giveaway item for business shows and promotional mailings. 


Test the Interface 


Testing is a key piece of the iterative development process. The goal of testing 
your product should be to measure user behavior, performance, and satisfaction. 
Many application development processes are not iterative, and testing (if in the 
process at all) is scheduled near the end of the development cycle. However, it is 
usually much too late in the cycle to make any changes in the product based on 
usability test results. Even if changes are made, how can you tell if the revised 
product is usable unless it is tested again! 

You must schedule several stages of usability tests that begin with early cus¬ 
tomer walk-throughs of initial designs. As pieces of the product and interface are 
built, get them in front of users and test again. When the product is nearing 
completion and all of the pieces are coming together, final system tests should 
then be conducted. Hopefully, you'll see few surprises if you have done iterative 
testing and incorporated user results and feedback during the process. 


K E Y I D E A ! 


You may decide to bring users into your own usability test 
lab or contract with a company or service organization to do your testing for you. 
One word of advice from experience-don't let developers test their own products! 
It doesn't work. You should use usability or human factors professionals who are 
not biased in any way about the product. Developers should observe and help in 
the testing of their products so that they can see how users really work with their 
products; just don't let them conduct the test themselves. 
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You may also want to install test systems at customer locations and let users 
give informal (and formal) feedback as they use the system. IBM developed nu¬ 
merous information kiosk systems that have been used in the 1984 Olympics and 
the 1991 World Games in Barcelona, Spain. These systems were thoroughly tested 
during the entire design and development process. One of the test methods was 
to install a kiosk in the lobby of one of the IBM buildings. A notebook was at¬ 
tached so that people could record their comments as they used the kiosk. These 
comments were read by the designers and were used to redesign the product and 
add additional features to the kiosk. The important point is to get everyone to try 
the product, not just selected participants. Assemble a "committee of dummies" 
and let them test drive the user interface! 


Follow a Development Process: Do It Timely and Do It Right! 


One of the key success factors in software development today is time-to-market. 
How quickly can you figure out what computer users want? How quickly and 
appropriately can you design and build it? And, most importantly, how quickly 
and cheaply can you get the product in customers' hands and on their computers. 
Having a workable and efficient development process is the way to make this 
happen. I'm not the only one who believes in the importance of Rapid Application 
Development (RAD) techniques. Christine Comaford (1992), a specialist in 
client/server application development says, "RAD doesn't just happen because 
you buy a snazzy GUI application development tool. You need a staff trained in 
GUI and client/server technologies. Mix in the right tool, the right architecture 
and a common code repository-then you'll get applications out the door rapidly." 

There are many, many ways to build a software development process. Just 
be sure you follow the basic elements, regardless of whatever flavor process you 
choose. Here's Comaford's guidelines for rapid application development: 

• Do intelligent prototypes. 

® Stick to GUI design standards. 

• Use only a few GUI designers. 

® Apply modern metrics to project estimation. 

® Write and distribute common code. 

* Perform code and user interface reviews. 

* Develop an enterprise-wide data model. 


The Interface Design Process 


127 



Does this process work for all software products? I can't guarantee it, but 
the same process works for industrial-strength products, such as computer-aided 
design (CAD) applications. David Kieras, a psychologist at the University of 
Michigan, describes phase one (research and planning) of a CAD design (Monk- 
iewicz, 1992), "First you have to figure out what it is that people are actually do¬ 
ing. You can't just stay in the office and write some software." 

Phase two (design) is outlined, "Interface designers must ask themselves 
whether a particular function can be accomplished more efficiently via graphical 
means or by menu selection." Also, Kieras notes, "The interface designers must at 
all times keep basic principles in mind, such as minimizing the number of steps 
required to perform basic functions, minimizing the overall time required to per¬ 
form these functions, and accommodating all classes of users." 

Finally, the article confirms the importance of phase three (prototype) and 
phase four (test), "Obviously, vendors must capture the user's view of the envi¬ 
ronment through an iterative process of testing, prototyping, and more testing." 
(I couldn't have said it better myself!) 

Building an effective product and interface design process itself is a con¬ 
tinual effort. Before you bet your career or the company on the "big" project, test 
out this development process on a smaller, less-critical project. But just 
remember-iterate, iterate, iterate. 
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GUIs and Menus: 

The Dawn of User Interfaces 


"How can you tell where you 're going 
if you don't know where you 've been ?' 


Popular Folksong 




Should You Upgrade Your Computer? Why Ask Why? 


"Anywhere you have chips, you have an interface. 

BillMoggridge, 1982 


Do you wonder why the software product you just purchased is labeled version 
4.02? Inside the shrink-wrapped package is a product registration card. You mail 
that back to the software manufacturer so they will let you know when the next 
product upgrade will be released. Didn't you just receive three upgrade diskettes 
in the mail for another software program you use? You probably have recently 
received a brochure in the mail for a new software program or tool. Your neigh¬ 
bor has already upgraded his computer to DOS 6.0 and you are still using DOS 
4.0. Are you feeling the guilty pangs of PC-envy? 

What is going on in the software industry? Why should you have to keep 
buying new products, versions, and upgrades to be able to do your work? Or, is 
that just what software companies want you to think? As hardware and software 
technology evolve, the tools you use every day will evolve also. Should you even 
try to keep up with all the updates, upgrades, and beta (pre-release version) pro¬ 
grams? Let’s try to make some sense of this seemingly never-ending situation. 

Here's the software story In Chapter 1,1 briefly discussed what an operating 
system is and what it does. With each new release of an operating system, the 
user interface elements and capabilities are enhanced to provide developers and 
users with better ways of presenting their information and interacting with it. 
Software developers need programming tools to build products that implement 
these interfaces. 

However, these tools can't be provided until the user interface architecture 
has been defined and implemented in the operating system. What we have here 
is the circular, never-ending cycle shown in Figure 6-1. There will always be some 
delay between the user interface architecture defined for an operating system, the 
operating system itself, and the available tools to build programs on that plat¬ 
form. 

This cycle is real and it is evolutionary. If customers and users of software 
products and user interfaces continue to thirst for new technology, the cycle will 
continue. Here's an example of the software technology cycle: 
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Figure 6-1 . The Software Technology Cycle 


® Part 1: The IBM CUA '91 user interface architecture was under devel¬ 
opment for two years, from 1989-1991. The fundamental concept in 
CUA '91 was the object-oriented Workplace Shell (I'll discuss this in 
great detail in Chapter 8). The CUA user interface guide and reference 
materials were published in 1991. 

® Part 2: Somewhat later in this same time period, the OS/2 2.0 operating 
system was built. The Workplace Shell interface barely made it into the 
product plan and, as such, was the last major piece to be developed. 
OS/2 2.0 was shipped in March, 1992. 

• Part 3: Tool vendors started releasing tools specifically for the OS/2 2.0 
development environment in late 1992 and early 1993. By the time 
some major tools reach the marketplace, the user interface architecture 
group is already full-steam ahead on the next version of the interface 
architecture. The software technology cycle for the OS/2 environment 
is shown in Figure 6-2. 
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Figure 6-2. The OS/2 Software Technology Cycle 


It is in both the operating system's and tool vendor's interest to 
have development tools available as soon as possible after the distribution of the 
operating system. The availability of development tools and key software prod¬ 
ucts (such as spreadsheets and word processors) is the most visible indication of 
the success or failure of operating systems and interfaces in today's marketplace. 

In this chapter. I'll take you on a historical tour of user interfaces and will 
describe the command-line and menu interface styles. It is important (and inter¬ 
esting) to see how the user interface styles that are popular today have evolved 
from the user interfaces of the past. For those of you who haven't taken the time 
for the tour, this may be uncharted territory for you, so hold on! 
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How User Interfaces and Operating Systems Are Related 


This chapter details the history of the development and evolution of computer 
software user interfaces, from the command-language interface all the way to 
menus, graphical user interfaces, and finally, object-oriented user interfaces. The 
development of user interface styles and technologies parallels the evolution of 
the personal computer operating systems, as user interfaces for software pro¬ 
grams are based on the interface style and technology afforded by the hardware 
and the operating system. 

Today's operating systems have expanded significantly beyond software 
designed solely for control of user input and computer output. In addition to the 
basic control of the computer hardware, operating systems offer networking ser¬ 
vices, object management facilities, multimedia device support, electronic mail, 
and even hardware optimization, such as disk compression. 

One of the single most important benefits an operating system provides to¬ 
day is the user interface style that it supports and promotes for product devel¬ 
opment. An operating system is itself a software product and thus has interface 
styles of its own. These interface styles are the most obvious trademark of an 
operating system. Apple's Macintosh is the prime example. The Mac computer is 
almost exclusively advertised and promoted by the (supposed) superiority and 
ease-of-use of the Mac interface. In addition to the Mac, the Windows Desktop 
embodies the graphical user interface (GUI) and OS/2's Workplace Shell repre¬ 
sents the object-oriented interface (OOUI) style. 

The operating system interface really defines the user interface paradigm for 
the computer software. A paradigm is, by definition, "an outstandingly clear or 
typical example or archetype." New interface technologies sometimes enable ma¬ 
jor steps forward, or "paradigm shifts" in the evolution of user interfaces. This is 
a major factor in the GUI-OOUI war. 


Bet You Can't Choose Just One! 


KEY IDEA! 


After reading this book, you should understand why you 
shouldn't be asked to choose one and only one user interface style to use for the 
rest of your computing life. I hope you will learn that there is no one program or 
interface style that will be the optimal one for you all the time. As we tour the 
different user interface styles in this chapter, keep an open mind and don't think 
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Figure 6-3. Interfaces and Their Users 


that you must pick and choose between the different styles. Remember, there are 
different styles for different folks and every user has the right to change their 
mind at any time! Also, different interface techniques are more appropriate for 
different tasks. If you were asked to write your signature on the computer screen, 
wouldn't you rather use a mouse than the keyboard arrow keys? On the other 
hand, if you were asked to draw a rectangle on the screen, using the keyboard ar¬ 
row keys would be much easier than trying to draw a rectangle using a mouse or 
a pen. 

For those reasons, most operating systems and programs offer more than one 
type of user interface style for users. This is much more work for system and 
applications designers and programmers, but this allows users of different skill 
levels to be able to use a product in a way they feel comfortable. It also provides 
users with the appropriate interface style and interaction technique for the task at 
hand. Most software products, from operating systems to application programs. 
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must be usable by a wide range of users: novice users, casual users, and "power 
users" or experts. 


In the Beginning, There Was DOS 


The personal computer became a commercial reality when IBM developed the PC 
in 1981. The first operating system for the IBM Personal Computer was PC-DOS 
Version 1.0, where DOS stands for Disk Operating System. It is now over ten 
years later, and some 50-100 million users later, DOS is still the most popular op¬ 
erating system for PCs. Figure 6-4 shows the evolution of DOS from Version 1.0 
through the current version. Version 6.0. The DOS Version 5.0 User's Guide and 
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Figure 6-4. Evolution of DOS 
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Reference (IBM, 1991a) simply states in the opening paragraph, "Welcome to 
DOS, the most widely used operating system for personal computers." 

While DOS still has the largest user base, it hasn't stood still technologically. 
DOS Version 5.0 is widely in use and Version 6.0 is now available. This evolution 
is described in the DOS Getting Started manual (IBM, 1991b), "New ideas, designs, 
and technologies in computer science evolve almost every day. New versions of 
DOS must support this technology. With each version of DOS, new or enhanced 
features and commands are introduced." 

None of the early DOS versions included any enhancements to the original 
user interface, only new functions and their associated commands. DOS 4.0 of¬ 
fered the first enhancement to the DOS command-line interface, the DOS Shell. 
While I will be using DOS as an example of a command-line interface in this 
chapter, please remember that DOS does offer the DOS Shell as a more usable in¬ 
terface alternative. Although I will be focusing on Windows and OS/2 through¬ 
out this book, the DOS Shell does include some of the other interface styles that I 
will be discussing as we move through the evolution of user interface styles. 


The Command-Line User Interface (CUI) 


"Rule number one for command-line interface users: 
Know What You Are About to Do, for there is No Undo. 

An Experienced Dos User 


The command-line interface is the original human-computer interaction style. 
Users type in requests or actions using a predetermined, formal language that has 
its own unique vocabulary, meanings, and syntax. In DOS, this language is a set 
of commands users type that are basic instructions to the DOS operating system. 
Similarly, any program can implement a command-line interface for its own 
product that allows users to type product-specific commands to run the program. 

In the traditional DOS command-line interface, the only information on the 
screen that is provided to prompt and instruct users is the well-known "ready 
prompt." To direct DOS to perform a task, you type a command and then press 
the Enter key on the computer keyboard. Users can typically enter commands at 
any time and commands can often be strung together in one request. Figure 6-5 
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C: \> 


Figure 6-5. DOS Command-Line Interface 


shows the typical DOS command-line interface. As you can see, this interface 
style doesn't provide much information to users, to say the least! 

There are a number of factors I'll discuss for each type of user interface style. 
These are: how the interface supports the user's model, how it supports user's 
memory capabilities, the semantics of the interface style, and the interface inter¬ 
action techniques. It is important to understand how each interface style allows 
designers to support the interface design principles I discussed in Chapter 3. 

Command-Line Interfaces and the User's Model 

The command-line interface is the least effective interface 
style to help support the user's model of how the computer system and its pro¬ 
grams work. How poorly does a command-line interface support the user's 
model? Look at the screen in Figure 6-5. If you were not an experienced DOS 
user, would you have any idea of what you could possibly do with your com¬ 
puter system? How are you to know what features you have on your system, 
such as the available printers? What programs are installed that you can use? 
And what are the DOS commands you have to know to use the system? 
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One of the key problems with the command-line interface is that it does not 
shield any of the operating system or program from users. To use the interface, 
users need to know how a computer works and where their programs and data 
reside. The model embodied in the command-line interface is the programmer’s 
model, not the user's model. 

Take a look at the DOS commands listed in Figure 6-6. These commands are 
only familiar to users if they are familiar with the way a computer works. For 
most people, learning to use a command-line interface is like trying to learn a 
foreign language. If you’re talking to someone who can only speak a foreign lan¬ 
guage that you don't understand, then you're going to have a very difficult time 
trying to communicate. However, if the person you're trying to communicate 
with can speak your language, although they can speak another language more 
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fluently, then you are going to have an easier time communicating. A computer 
has its own internal language, but it doesn't have to force users to speak its lan¬ 
guage when it has the ability to speak the user's language. 

Today's computer software systems have the power and capability to present 
information and communicate in ways that are familiar to users, rather than ways 
that assume users have a complete understanding of how the computer works. 
Command-line interfaces don't do very well at all in this respect, but there are 
advantages to command-line interfaces, as you'll see. 

Look at the sequence of commands in Figure 6-7. All I was trying to do here 
was delete the HELRTXT file in my TEMP directory. The commands in lower 
case letters are the commands I typed. The DIR command tells me what files are 
in the current directory, assuming that I was already in the directory I was look¬ 
ing for. I had to type the DIR command first because I didn't know what files 
were in the directory. There is no indication of what's in a directory when you get 
there. 


f A 

C:\TEMP> dir 

The volume label in drive C is IBMDOS_5. 

Directory of C:\TEMP 

HELP TXT 666 3-28-9312:53p 

COMMANDS DOS 1286 3-27-93 l:35p 
2 file(s) 1952 bytes used 
3080192 bytes free 

C:\TEMP> del help.txt 

C:\TEMP> dir 

The volume label in drive C is IBMDOS_5. 

Directory of C:\TEMP 

COMMANDS DOS 1286 3-27-93 l:35p 
1 file(s) 1286 bytes used 
3084288 bytes free 


C:\TEMP> 

V_ 


J 


Figure 6-7. Superstitious User Behaviors 
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The DEL command deletes a file, but with the command-line interface, there 
is usually no feedback regarding the status of the system or feedback regarding a 
user action. After a command is entered, the system usually responds with just 
the ready prompt. This lack of feedback leads users to distrust the system and 
leads them to confirm the results of their actions on their own. I call these super¬ 
stitious behaviors. When I move, copy, or delete files using DOS commands, I 
always type the directory command (DIR) after the action I wanted, to make sure 
that the actions were done correctly. I do this because it's easy to make errors 
with the DOS commands. So, in this example, I typed DIR again to make sure 
the file had been deleted. If there had been a simple one-line message, "File(s) 
deleted," this superstitious behavior would be discouraged. 

Look at the language spoken by DOS during our conversation. DOS re¬ 
quired me to know where my files were stored on the computer and which 
commands to use to delete files. Also look at the extraneous information that 
DOS provided. What do I care about The volume label in drive C? Screen space is 
valuable real estate, so don't waste it. The "File deleted" response is much more 
valuable information to users than stating the volume label of the drive. Whose 
model is this user interface following? You guessed it, the programmer's model. 

On the other hand, the command-line interface is very powerful, flexible, 
and is totally user-controlled. However, this is an advantage mostly for those 
experienced users that fit the programmer's model rather than the user's model. 
For example, the use of wildcards allows users to perform the same task for a 
group of objects. The one command, DIR THEO?.* /S, will list all of the files that 
are named THEO_ (with any one character in the fifth position) with any exten¬ 
sion name (the * wildcard) in the current directory and all subdirectories of the 
current directory (the IS option). 

Going back to the Sandwich program I talked about in Chapter 2, a 
command-line interface for this program is much like an adventure game. Not 
only do you have to figure out how to make the jam sandwich, you have to figure 
out what are the commands to perform the actions. I asked my wife to try the 
command-line version of the game. She thought it was fun for a little while, but 
then she got very frustrated when none of the commands she typed were ac¬ 
cepted by the program. Figure 6-8 shows some typical interactions with the 
command-line interface for the game. 

In this example, the text in all capitals is the user input. As you can see, it is 
difficult to figure out the context of the program from this type of interface. If you 
were the programmer, the command-line interface would be the fastest path to 
perform all of the actions and make a jam sandwich. However, a casual user 
would have a very difficult time performing the task. 
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D:\SANDWICH> SANDW1 
Adventure game version 1.00 

You are now at the kitchendoor 


Which action do you want ? GO IN 
I do not understand GO IN 

You are now at the kitchendoor 

Which action do you want ? GO 

To where ? REFRIGERATOR 
I do not know where REFRIGERATOR is 

You are now at the kitchendoor 

Which action do you want ? GO 

To where ? FRIDGE 

You are now at the fridge 

Which action do you want ? TAKE BUTTER 
I do not understand TAKE BUTTER 

You are now at the fridge 

Which action do you want ? TAKE 

v What? BUTTER _ 

Figure 6-8. Jam Sandwich Command-Line Interface 


I like to watch people use a command-line interface for either an operating 
system like DOS, or for a particular program. When I watch someone using the 
DOS commands, I see how people use the commands quite differently and I al¬ 
ways learn some new commands or some new parameter for a command that I 
didn't know about. We tend to bestow honor and respect on those expert users 
who can zip through the command-line interface with the skill and mastery of a 
surgeon. 

If users are programmers or experts on the program or operating system, 
then the command-line interface can be very powerful. This is because the inter¬ 
face is built on the programmer's model. It takes longer to learn the interface, but 
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can be much faster for end-use. What we have is a trade-off between ease-of- 
learning and ease-of-use for certain users and certain tasks. 


Command-Line Interfaces and Users' Memory 

The command-line interface provides little support for the user interface design 
principles that reduce the user's memory load (discussed in Chapter 3). As a DOS 
user, how many of the DOS commands could you recall from memory, without 
any cues, if you were asked? Never mind recalling them, how many commands 
do you even recognize in Figure 6-6? How many of these commands do you re¬ 
ally know and use? Casual and infrequent use of a command-line interface leads 
users to forget commands that have even been learned and have already became 
familiar. 

Command-line interfaces force users to remember commands by having to 
recall them from memory without any cues from the system. Studies (Furnas, 
1985) have shown that users can only guess the names of commands chosen by 
designers about 10-15 percent of the time. This is why most command-line inter¬ 
face users have a user's guide and reference handy while they work. They also 
have the phone number of someone down the hall who is the well-known 
command-line interface guru. (There really are a few people who know every 
one of the DOS commands and how to use them!) Command-line interfaces are 
much more difficult to learn than other interface styles. Even once commands are 
learned, time away from the interface and lack of practice make memory reten¬ 
tion poor for commands. 

Because command-line interfaces don't provide cues for command retrieval, 
good help systems are critical for operating systems and programs. As software 
systems have evolved, online help systems have also become more sophisticated 
and more useful. Figure 6-9 shows the help information for the DIR command, 
which is a very simple command that lists the contents of a directory. User's 
guides, reference manuals, and online help systems serve as external memory for 
users, because it is difficult for humans to remember things like command names 
unless the commands are familiar and have some meaning to them. Look at the 
syntax statement and the parameter list for the DIR command. Can you make 
sense of the command syntax and the options even if you read it over and over 
again? And this is one of the simplest DOS commands! 

One way to improve on the memory limitations associated with command¬ 
line interfaces is to provide prompting or use a question and answer style inter¬ 
face. The Jam Sandwich program in Figure 6-8 shows some prompting, but as 
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C:\> DIR /? 


Use the DIR command to list the files and subdirectories. 

SYNTAX: DIR [drive:] [filename] [/A[adshr]] [/B] [/F] 

[/L] [/N] [/Otnedsg]] [/P] [/S] [/W] [/R] 

Where: 

[drive:][filename] Specifies the directories and 
files to list. 

/A[adshr] Displays only specified attributes. 

/B Displays only filename and extension. 

/F Displays only fully-qualified files and directories. 

/L Displays directory information in lower case letters. 

/N Displays the listing in the new OS/2 format. 

/Ofnedsg] Orders the display by specified fields. 

IF Pauses after each screen of information. 

IS Displays all subdirectories. 

/W Displays the directory listing horizontally. 

/R Displays .LONGNAME extended attributes. 

I C:\>_ _J 

Figure 6-9. On-Screen Help for the DIR Command 

I’ve discussed, even prompting doesn't help an interface when the underlying 
models of the designer and programmer don't mesh well with the user's model. 

The Semantics of Command-Line Interfaces 

As command-line interfaces are designed, effort must be made to ensure that the 
command language is understood and functionally appropriate for users and 
their tasks at hand. Designers must determine the function they will build into 
the interface and the commands for users to access those functions. Can you un¬ 
derstand the relationship between DOS commands and their associated func¬ 
tions? Don't some commands seem ambiguous or too similar to other com¬ 
mands? 

A major problem with command-line interfaces is that the meanings of 
commands are not well understood. Sometimes different commands have very 
close or even the same meaning. Take the DEL and ERASE commands in DOS, 
for example. Not only do they seem to be very similar, they actually perform the 
same function. This is not a good thing to do to users. If users see two com- 
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mands, they expect them to do different things. Here's the help text for both the 
DEL and ERASE commands (Figure 6-10). They provide the same function, have 
the same help text, yet have different command names. No wonder users are 
confused by command-line interfaces! 

One final point about the semantics of command-line interfaces. A good in¬ 
terface allows users to be somewhat flexible with their actions, as long as their in¬ 
tentions are correct. A poor interface punishes users for straying from the exact 
form of the command, even if their actions are appropriate. A perfect example is 
this discussion of these simple DOS commands. The help text for the DEL com¬ 
mand (Figure 6-10) states that the definition of the command is to "delete one or 
more files." Obviously the command was named DEL as an abbreviation of the 
word delete. Users should be able to remember the appropriate command by re¬ 
membering the function it performs (delete) and the command name (delete). 
However, due to some DOS system programmer's inconsiderate and inflexible 
programming style, if users type DELETE, it is not accepted as a valid command. 
This inflexibility does not lead users to call DOS a user-friendly user interface! 


/ N 

C:\> DEL /? 

Use the ERASE or DEL command to delete one or more files. 

SYNTAX: ERASE [drive:][path]filename [/P] 

DEL [drive:] [path]filename [/P] 

Where: 

[drive:][path]filename Specifies the file to delete. The 
global file name characters * and ? can 
be used in the file name specified. 

IF Prompts for confirmation before deleting each file. 

C:\> ERASE /? 

Use the ERASE or DEL command to delete one or more files. 

SYNTAX: ERASE [drive:][path]filename [IF] 

DEL [drive:][path]filename [/P] 

V___1_ J 


Figure 6-1 0 . The Confusing DEL and ERASE Commands 
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How Do Users Interact with Command-Line Interfaces? 


First of all, a command-line interface style assumes that users have a keyboard to 
input commands. There are some modern-day, voice-driven command interfaces, 
but they basically have the same advantages and disadvantages with keyboard 
driven command-line styles. If you're a mouse user, you won't need it when you 
are using a command-line interface. 

User interaction with command-line interfaces most often involves a com¬ 
mand syntax style that is action-object oriented. Most commands are verbs or ac¬ 
tions that users would like to perform. Users first type the action (for example, 
PRINT) then the object or file (for example, MANDEL.DOC) on which they wish 
to perform the action. Figure 6-9 shows the syntax for the DIR command. DIR is 
the action, a particular drive or filename is the object, and there are multiple op¬ 
tions for the command. 

This command syntax allows for powerful interaction, yet also produces 
very high error rates. Commands must be typed exactly as defined, so typing 
skill is very important and is directly related to error rates. Consistency is critical 
in defining command-line interaction syntax for commands. For example, the 
COPY command seems straightforward. The definition for the COPY command 
is that it "Copies one or more files to another location." The command syntax is 
COPY the source object to the target location. Seems simple enough, right? 
However, things are more complicated than they seem. The target object can 
consist of a drive, a directory, a file, or some combination of them. 

Any typing errors can be dangerous. I want to copy the file SOURCE.TXT 
to the directory, ABCD. If I type it correctly as I do first in the Figure 6-11, the 
correct action takes place and I'm told one file is copied. I double-check the 
ABCD directory and the file has been successfully copied. However, if I type the 
directory name incorrectly by mistake as ABDC, however, the target name is now 
assumed to be a new file name, rather than a directory name as I had wanted (see 
Figure 6-12). This results in a new file that is created in the same directory instead 
of copying the file to a different directory. Yet I am given the same feedback that a 
file has been copied. Only after typing DIR to see what is in the current directory 
do I see that a new file has been created. These types of errors are very common 
in command-line interfaces. Sometimes these errors are only annoying, but they 
can easily be harmful to users who don't even know they have made an error. 

Also notice the inconsistent user feedback from DOS in my examples. Ear¬ 
lier I complained that there was no feedback when I deleted files using the DEL 
command, so I usually check again to see if files actually were deleted. However, 
with the COPY command, there is feedback that "1 file(s) copied." The same 
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C:\> dir 

The volume label in drive C is IBMDOS_5. 

The Volume Serial Number is 177B:5811 
Directory of C:\ 

ABCD <DIR> 3-31-93 8:00p 
SOURCE TXT 1286 3-27-93 l:35p 

2 file(s) 1286 bytes used 

3078144 bytes free 

C:\> copy source.txt abed 
1 file(s) copied. 

C:\> dir abed 

The volume label in drive C is IBMDOS_5. 

The Volume Serial Number is 177B:5811 
Directory of C:\abcd 

<DIR> 3-31-93 8:00p 

<DIR> 3-31-93 8:00p 

SOURCE TXT 1286 3-27-93 l:35p 

3 file(s) 1286 bytes used 

3078144 bytes free 

C:\> _ 

V_ ) 


FIGURE 6-11 . The COPY Command Problem, Part 1 


simple feedback for the COPY command would be greatly appreciated by the one 
hundred million DOS users for the DEL command and for the rest of the one 
hundred DOS commands. 

The command-line interaction syntax can be improved with prompting to 
make the conversation more interactive. For example, users could first type the 
command name. The interface would then prompt for the appropriate location 
and object(s) for which to apply the action. This interaction style is more work for 
the programmer, but may be more useful for novice or casual users in certain cir¬ 
cumstances. 
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C:\> dir 
Directory of C:\ 

ABCD <DIR> 3-31-93 8:00p 
SOURCE TXT 1286 3-27-93 l:35p 
2 file(s) 1286 bytes used 
3078144 bytes free 

C:\> copy source.txt abdc 

1 file(s) copied. 

C:\> dir abed 

Directory of C:\abcd 

<DIR> 3-31-93 8:00p 

<DIR> 3-31-93 8:00p 

2 filets) 0 bytes used 

3078144 bytes free 

C:\> dir 
Directory of C:\ 

ABCD <DIR> 3-31-93 8:00p 
SOURCE TXT 1286 3-27-93 l:35p 
ABDC 1286 3-27-93 l:35p 

3 filets) 1286 bytes used 

3078144 bytes free 


I C:\>_ 

FIGURE 6-12. The COPY Command Problem, Part 2 


Command-Line Interface Summary 

WLMMSMMMiMM Although DOS is the most widely used operating system in 
the world, a command-line interface is best suited to expert users rather than 
novice users. The command-line interface was the only available way for the first 
users to communicate with their computers. These users were typically computer 
hobbyists and electronics enthusiasts who were both skilled and motivated to use 
computers. Today's users are motivated to do their task as quickly and as easily 
as possible, and they are not necessarily even happy about using a computer. 
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The interface test results are many and very consistent in their conclusions: 
command-line interfaces are faster and better for experienced users, but worse for 
novice and casual users. Don't take my word for it, look at any user interface 
guide, textbook, or research report. Either way, a command-line interface is not 
typically your most user-friendly interface. Because of the limited presentation 
and interaction technology and techniques, it is difficult to follow the basic design 
principles I outlined in Chapter 3. 


Advantages 

• Quick and powerful form of interaction for experienced users 

• Flexible interface, easy to combine commands and parameters 

• User-controlled interaction 

• Uses minimal screen space 

• Fast and efficient interface for knowledgeable users 

• Allows abbreviated command names 

• Minimal amount of typing required 

• Can be used in conjunction with other user interfaces 

Disadvantages 

® Little or no prompting and instructions on-screen 
® Interface enhancements are not visible or known 

• Usually requires use of hardcopy or online memory aids 

• Requires user's knowledge of system, programs, and data 

• Usually provides no feedback or task status 

• Assumes typing skills 

® Relies on recall of commands and syntax 

• Difficult to learn 

• Command names are not meaningful to users 

• Command syntax is often difficult to understand 

• Commands syntax must be followed exactly (error-prone) 

• Commands and syntax are usually not user-customizable 


FIGURE 6-13. Advantages and Disadvantages of Command-Line Interfaces 
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KEY IDEA! 


Figure 6-13 summarizes the advantages and disadvantages of 
designing and using command-line user interfaces. The conclusion I've reached 
is as follows: Don't design only a command-line interface unless you have only 
experienced users and that is the only interface they want. A much better ap¬ 
proach is to design other interface styles for your product and then later come 
back and design a command-line interface and its syntax for your experienced 
users. But do this only after you've built a more user-friendly interface for novice 
and casual users. 


Menu Interfaces: Are You Being Served? 


Everyone is familiar with menus, but not necessarily as a computer user interface 
style. We use menus almost daily, especially those of us who eat out a lot! If 
computer interface designers want to draw on users' everyday experiences in 
their environment, then computer menus should be very similar to the menus we 
are already familiar with. This allows users to transfer their real-world knowl¬ 
edge into the software interface arena. A menu is simply a list of options that are 
displayed on the screen or in a window on the screen for users to select their de¬ 
sired choice. Figure 6-14 shows a typical full-screen menu interface for a simple 
word processing application. 

Menus are typically used for two main purposes. They allow users to navi¬ 
gate within a system by presenting routings from one place to another in the sys¬ 
tem, or from one menu to another. They also allow users to select items or choices 
from a list. These choices are usually actions users wish to perform on selected 
objects. 


b r« wsm’WMm Menu choices are often text items, but they certainly are not 
limited to text. In this section you'll see menu items that are text, icons, patterns, 
colors, and symbols. The visual representation of a user choice should be what¬ 
ever is appropriate for the interface environment and the tasks they are trying to 
perform. For example, think about a graphics program. Providing menus of the 
various colors and patterns available is a good interface design decision. How¬ 
ever, it doesn't make sense to use a menu to just list the names of the colors (red, 
green, blue, and so on). A graphical menu can show the menu choices as the ac¬ 
tual colors as they will appear on the screen to users. The same applies to the 
patterns menu. Show users actual items rather than text information describing 
the choices. You'll see examples of these types of menus in the next few figures. 
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IBM Writing Assistant 


Version 2.00 

Copyright IBM Corporation 1984, 1986 
Copyright Software Publishing Corporation 1984, 1986 
Synonyns (C) Houghton Mifflin Conpany, 1982 


Main Menu 


2. Define page 

3. Print 

4. Get 

5. Save 

6. Remove 
T. Clear 


FIGURE 6-14. Full-Screen Menu Interfaces 


Menu interface styles evolved as the personal computer became more of an 
end-user tool rather than just a programmer's black box or a computer 
enthusiast's toy. Menus have perhaps become the most popular interface style, 
especially for new or casual users. All of the key commercial software packages 
use menus in some form. Menus are the primary interface style for some of these 
products, and even the most recent graphical or object-oriented software pro¬ 
grams use menus extensively. Remember, all of these interface styles are not mu¬ 
tually exclusive and users should be allowed to use whatever interaction style 
suits them at any particular time. 

Good menu interface design is a highly-skilled art. Just as 
there are many examples of poor command-line interfaces, there are just as many 
poorly-designed menu interfaces. I won't cover specific guidelines for menu de¬ 
sign here, as there are many good sources for guidance I've already mentioned in 
Chapter 3. However, my discussion here does provide guidance for designing 
menu interfaces with respect to user's needs, tasks, and memory limitations. 
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First let's look at the different types of menus. They come in various shapes, 
sizes, and styles. Some of these interface styles you've used in software pro¬ 
grams, but you may have never realized that you were using menus. 


Full-Screen Menus 

The earliest type of menu interface was the full-screen application-driven pro¬ 
gram interface shown in Figure 6-14. The functions or task available to users at 
any point in time are represented as a list of choices on the screen. The main de¬ 
fining characteristic of most full-screen menu interfaces is that they are usually 
hierarchically structured. That is, users must travel through a treelike structure of 
menus to accomplish their task. 

The Writing Assistant program shown in Figure 6-14 allows users to navi¬ 
gate to the different sections of the program from this first screen, the main menu. 
There are both good and bad points to a rigidly-structured menu interface. I'll 
discuss them when I talk about menu interaction techniques. 


Menu Bars and Palettes 

Most of the graphical programs available today have a form of menu bar, or action 
bar, across the top of the screen or window. This menu style provides ready ac¬ 
cess to menus while users are working within program screens or windows. A 
menu bar is usually a dynamic list of major sets of actions or choices that route 
users to choices presented in individually displayed pull-down menus. Figure 6-15 
shows a menu bar and pull-down menu in a graphical interface. This is the 
DeScribe® word-processing program I've used to write this book. The menu bar 
is across the top of the window, with the items. File, Edit, View, and so on. The 
Frames pull-down menu is also shown. Pull-down menus can be extended onto a 
second level called a cascaded menu. The list of frame numbers to the right of the 
Frames choice is a cascaded menu. 

Menu bars are an integral part of all major graphical user interfaces, such as 
the Macintosh, Windows, and OS/2, and all of the programs designed for these 
operating systems. Consistent use of menu bars by designers and programmers 
provides a stable, familiar presentation and interaction environment for users 
both within and across programs they use on their computers. 
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File Edit View Words Style j Frames Utilities Options Window Help 

Frame 1 ^ 

Frame 10 ™ 
Frame 11 
Frame 2 _ 

Frame 3 
Frame 4 
Frame 5 
Frame 6 
Frame 7 
More... 


New picture 
New note 

Pagenijii'i tiers. 


Move frame 
Size frame 
Next frame 

Modify template 


Frame 2 
Frame 3 
Frame 4 
Frame 5 
Frame 6 
Frame 7 
Frame 8 
Frame 9 


Ctrl+J 


Help j 


•Text line 1326:10, page 43. Font: Palatino 11/13 Style: \Body Text* 


Figure 6-1 5 . DeScribe® Menu Bar, Pull-Down Menu, and Cascaded Menu 


A key feature of menu bars and pull-downs is that they have the capability 
of dynamically changing. This provides users with only the valid choices and 
routings appropriate for their current tasks or for specific objects users have se¬ 
lected. Menu choices can also be grayed out to show that certain actions are not 
currently available. The Page numbers... option on the Frame pull-down shows 
this type of user feedback. Users can easily explore menus to see what actions, 
routings, and choices are available to them at any time. 

There are a few new types of menus these days. One is called detachable 
menus. Users can choose a menu that they use often during a task, such as the 
Edit pull-down menu while creating a graphic illustration, and keep it open 
anywhere on the screen. This saves the step of selecting the Edit menu bar item 
each time they wish to select a choice from that pull-down menu. 
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A similar type of menu is a tool bar or palette. This is usually a graphical 
menu of program actions, tools, and options users can place around the computer 
screen. Figure 6-15 show the DeScribe tool bar just below the menu bar. I also 
placed the styles palette on the left side of the window. Most graphic programs 
offer tool bars and palettes to help users easily choose the appropriate drawing 
and editing tools, colors, patterns, and styles to do their work. Figure 6-16 shows 
the same tool palette in a floating menu and the patterns, draw tools, and color 
palettes. The Custom Tool Manager dialog allows users to customize the contents 
and location of the tool bar. The goal of these interface styles is to give users a 
very comfortable and intuitive feeling. 
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Figure 6-1 6 . DeScribe® Tool Bar, Drawing Palettes, and Tool Manager 
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Pop-Up Menus 


The most recent menu style to have evolved in today's user interface environment 
is the pop-up menu. It is also called a context menu, because the contents of the 
menu depends upon the context of the users' tasks at hand. Pop-up menus are 
appropriate in any type of application, whether it is a full-screen or graphical in¬ 
terface. They are called pop-up menus because they appear to "pop-up" on the 
screen next to an item when users press the appropriate key or mouse button. 
Figure 6-17 shows a pop-up menu. 

Pop-up menus contain only those choices that are appropriate to the current 
or selected item. These are incredibly powerful interfaces for users, as pop-ups 
can be designed for any element of the interface. Every icon, menu choice, win¬ 
dow element, or interface control (a scroll bar, for example) that is selectable by 
users can have a pop-up menu. Pop-up menus usually contain a small set of 
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Create shadow... 
Delete... 



Multimedia 


Figure 6-17. Pop-Up Menu 
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frequently used actions that are also available from the system or program menu 
bar, if one is implemented. 

That's a quick description of the different types of menus in today's inter¬ 
faces. I'm sure you'll agree that they seem more helpful than the command-line 
interface. Let's now look at just how the menu interface styles support the user's 
model, how it supports user's memory capabilities, the semantics of menus, and 
menu interface interaction techniques. 


Menu Interfaces and the User's Model 

Menus are a very powerful means of translating the programmer's view of the 
system into something that users can see, understand, and use. Menus provide a 
visual representation of the structure of the underlying system or application and 
the selections users can make at any time. 

The key success factor in the design of menus is how skillfully the underly¬ 
ing computer concepts and functions are translated into a coherent set of user 
options. Again, this is the designer's job to work with the programmer's model 
and build a user interface that is appropriate for user tasks and is consistent with 
the user's model. 

Menus should provide users with the routings and choices that fit their model. 
Let's go back to the jam sandwich scenario. With the command-line interface, 
users had no idea where to go in the kitchen (routings) to find the utensils and 
ingredients (choices) to make the sandwich. Figure 6-18 shows the graphical 
version of the program. It provides both a menu listing the places to go (routings) 
in the kitchen and menus showing the contents (choices) of the drawer, cupboard, 
and the refrigerator. Users don't have to guess where the programmer hid the 
knives or the bread in the kitchen, as you did with the command-line interface. 

Well-designed menu interfaces allow users to learn the interface easily. Even 
if users don't fully understand the underlying system, menus can make the task 
of learning the system routings and choices more visible and explicit. Therefore, 
menus can be very useful for interfaces where users don't need to be in control, 
where users are not allowed to control the system, and where users don't need to 
really understand the system to do their tasks. 

As part of the learning process, many systems and products offer users a 
choice of menu styles they wish to work with. Many popular programs such as 
spreadsheets and word processors provide both simple and complex menus. 
Simple menus only present a minimal set of actions and menus that novices or 
new learners would use. Complex menus provide the complete set of program 
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Figure 6-1 8 . Jam Sandwich Graphical Interface with Menus 


actions and choices. Users just learning the product or doing very simple tasks 
would choose the simple menus so they wouldn't have to even see the complexity 
of the rest of the program functions. Experienced users would probably choose 
the complex menus. DeScribe offers these options, calling them novice and stan¬ 
dard modes. 


Menu Interfaces and Users' Memory 

As menus are easy-to-learn, so are they easy-to-remember. Users don’t have to 
remember complex command names and syntax as they do for a command-line 
interface. Menus rely on users' recognition memory rather than recall of infor¬ 
mation from memory. Users don't have to worry about hidden or new functions. 
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If their system is upgraded and new features or options are available, they should 
see changes or additions to the menus on the screen. 

Menus do, however, take up valuable space on the screen. Full-screen menu 
interfaces like the one shown in Figure 6-14 use the entire screen to present each 
menu with its choices. The other menu types use screen space more carefully, 
mainly because they are usually part of graphical interfaces, where screen real es¬ 
tate is of prime importance. 

To help users' short-term memory, menus should not require users to re¬ 
member information from a previous menu or screen in order to make a selection 
on the current menu. If that information is needed, the system should present the 
information wherever it is needed, not just on the original screen. As I mentioned 
earlier, I am amazed how often airline and hotel telephone reservation agents 
have to ask me for the same information more than once during a transaction. 
This happens because they are on a different menu or screen than the one where 
they originally entered the information. The program doesn't carry the informa¬ 
tion entered in one menu or screen over to another menu where it is needed. You 
would think that program designers would have received a strong requirement 
from users regarding this. 

The number of items that are placed in a menu should also be influenced by 
human short-term memory limitations. The capacity of short-term memory is 
known to be around seven plus-or-minus two items. Users won't be able to re¬ 
member what is in a menu as they navigate throughout the menu hierarchy if 
each menu has too many items. In order to maximize screen space and provide 
all the information to users, many menu interfaces violate this design principle. 
Long menu lists can usually be grouped into smaller logical groups to chunk 
items for users to remember more easily. 

One product reviewer (Basch, 1992) discussed a menu-based program called 
DIALOG. He commented, "With 22 items on its main menu, DIALOG Menus is a 
very ambitious product designed to cover almost every DIALOG database, the 
ONTAP practice files, DIALMAIL, and help with database selection." I'm going 
to use this product as an example of how even a little knowledge of users and 
human memory can help in interface design. Even though you (and I also) know 
nothing about this software product, I would hope that after reading 150 pages of 
this book you know enough about interface design to see that something is wrong 
with this interface, just by reading this one sentence! As an interface design con¬ 
sultant, how would you suggest we redesign this interface? Yes, you've got it. 
Let me see if I can explain what you are thinking. 

Just by analyzing the sentence describing the interface (Phase 1: Research 
and planning), you can see that on this main menu with 22 items, there seem to be 
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three logical groups of things: 1. DIALOG databases, 2. ONTAP practice files, 
and 3. DIALMAIL. Even though we don't know what these things are, or exactly 
how many items there are in each group, 22 divided by 3 gives us approximately 
7 items per group. That's right in the ballpark for the appropriate number of 
items per menu, based on the seven plus-or-minus short-term memory rule. So, 
I'd guess that you would redesign the program to have a main menu listing the 
three major groups you just determined. Selecting each item would lead to a new 
menu containing the approximately seven items for that menu topic. Sound 
good? And, by the way. I'm sure you'd have some HELP available from each 
menu, as mentioned by the reviewer. Congratulations, you've just designed a 
program's menu interface! Figure 6-19 shows the before and after designs for this 
program's menus. Nice job, you’re learning the skills to become a user interface 
designer. 


KEY IDEA! 


I have found that as a user interface consultant, it is usually 
an advantage not to know too much about the particular industry or environment 
in which a product is developed. I’m not alone in this approach. Martin Heller 
(1993) starts his article in Windows Magazine by saying, "One lesson I learned re¬ 
cently is that I make better decisions thinking like a consultant than I do thinking 
like a programmer.” By approaching the product interface from a more naive 
viewpoint, I am much closer to users' views of the product than the designer and 
programmer’s view. As we progress into the review and design of the interface I 
consciously try to remain as close to users' perspectives as possible by asking lots 
of "dumb user" questions of the designers and programmers. Rather than trying 
to learn more about the product from the developers, I try to see how users of 
various skill levels would learn to use the interface. Because a designer or con¬ 
sultant isn't necessarily a subject-matter expert in the product's technical area, it is 
easier to focus on the users' perspectives. 


Menus can also help aid long-term memory retrieval. Menu interfaces 
should be designed to present items in logical groupings rather than simply in 
alphabetical or random order. The screen layout and organization of menus allow 
users to assign meanings to the groupings and makes both the menus and the 
individual choices more memorable. 

Taking this even further, today's menu interfaces often allow users to cus¬ 
tomize menu organization and layout to more closely fit the way they use the 
system and how they remember menus and menu choices. DeScribe’s Word Pro¬ 
cessor 4.0 for OS/2 allows users to customize every menu in the interface. You 
can totally customize the menu bar using the Menu Manager and the tool bar us- 
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Figure 6-1 9. Original Menu and Revised Menu Design 


ing the Tool Manager (see Figures 6-15 and 6-16). Customizing enables users to 
feel more comfortable using a program the way they like to work. This all goes 
back to a key interface design principle: place users in control! 
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The Semantics of Menu Interfaces 


Menu terminology can cause user confusion, regardless of how well- 
structured and laid-out the menus may be. At times, there are commands that 
seem very similar and yet have very different meanings. How about menu 
choices such as exit, quit, escape, close, return, forward, back, enter, accept, up, 
and down? I’ve seen all of these choices in menus and they can be very confusing 
to users. They all have something to do with navigating within a menu interface. 
Different programmers may define these terms and their actions very differently, 
so there is often no consistency between menus even within the same program, 
and definitely a lack of consistency across programs. In the end, unknowing and 
unassuming users will interpret these terms based on their own experiences and 
make their selections accordingly. Will their expectations of a menu choice match 
the programmer's implementation of that action? We can only hope! 


Summary of Menu Interfaces 

By now you've learned that well-structured menu interfaces, such as full-screen 
menus, are great for novice and casual users. Menu bars, pull-down menus, cas¬ 
caded menus, tool bars, palettes, and pop-up menus are all interface elements that 
are used in combination with other elements in today's programs. 

Why have I discussed menus in such great detail in this 
chapter? They are a very important user interface style and are an integral aspect 
of the graphical user interfaces and object-oriented user interfaces discussed in 
this book. If you think that the current focus on the GUI-OOUI war has left 
menus behind in the dust, you are mistaken. True, completely menu-driven pro¬ 
grams are not as popular today. However, I hope you now see that menus will 
continue to evolve and are an appropriate and important interface style. 

Figure 6-20 presents a summary of the general advantages and disadvan¬ 
tages of using menus. Please remember that menus are mainly used in conjunc¬ 
tion with the other interface styles. The advantages and disadvantages of any in¬ 
terface style must be weighed with the characteristics of the other interface styles 
when they are used together. 
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Advantages 

• Users don’t have to memorize complex commands 

• Reduces keyboard entry errors 

• Structured navigation benefits novices and casual users 

• Can shorten user learning time and effort 

• Easy to track correct responses and errors 
® Minimal amount of typing required 

• Can be used in conjunction with other user interfaces 

• Menu items and layout may be user-customizable 

• Flexible selection techniques (mnemonics, mouse) 

® Supports recognition memory vs. recall 

Disadvantages 

• May not be appropriate or efficient for some users and tasks 

• Fast-path navigation and selection techniques are also needed 

• Don't necessarily or automatically make an interface easier to use 

• Uses lots of screen space 

• Can force user through many levels of menus 

• Requires quick screen display and refresh rates 

• Relies on users understanding menu groupings and hierarchy 

• Requires some knowledge of underlying system 

• Users may get lost in menu hierarchies 

• Menu terms and names may not be meaningful to users 

• Menu structure follows the action-object syntax 

• Menu syntax must be followed exactly 

• Use of modes forces users to follow the system’s path 


Figure 6-20. Advantages and Disadvantages of Menu Interfaces 
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Microsoft Windows™: 
A GUI for the Masses 


"The Goal of the Microsoft Windows 
Graphical environment is to make the 
PC personable, so people can easily tap 
its power to manage information." 


"One-To-One with Microsoft", 1990 



On the Road to GUI: Picking Apples in the PARC 


"When everything in a computer system is visible on the screen, 
the display becomes reality. Objects and actions can be understood 
purely in terms of their effects upon the display. This vastly 
simplifies understanding and reduces learning time." 

A Designer of the Xerox Star 


The Apple Macintosh is commonly thought of as the product that brought 
the graphical user interface (GUI) to life as a commercially successful personal 
computer desktop. While this may be true, the history of GUIs goes back much 
further than that. There is a rich and complicated path that leads to the 
GUI-OOUI war we have on the PC desktop today. 

It is widely believed that the grandfather of the GUI was the Sketchpad 
program developed in 1962 by Ivan Sutherland at the Massachusetts Institute of 
Technology. The program allowed users to draw lines, circles, and points on 
a computer's cathode ray tube (CRT) display using a light pen. While these tasks 
are simple with today's computer software and interfaces, thirty years ago this 
was a revolutionary effort that required immense computing power. Sutherland's 
program was the first windowing software that assigned characteristics to 
graphic objects and built relationships between objects. Users could move, copy, 
scale, zoom, rotate objects, and save object characteristics. Although this research 
never was commercially developed, most software engineers credit Sutherland's 
Sketchpad research and designs as the first step in the evolution of graphical user 
interface. 

The mouse, now the main instrument of input yielded by GUI users, was 
developed in the late 1960s. Douglas Engelbart began his work in 1964 on a 
hand-held pointing device at SRI International in Menlo Park, California and car¬ 
ried on with his experimental designs at the famous Xerox Palo Alto Research 
Center, know as Xerox PARC (hence the reference in my section title). The cul¬ 
mination of this work was the first patent for the wheel mouse in 1970. 

Continued research and design on the mouse led to the patent for the ball 
mouse in 1974 by Xerox. The idea came suddenly to Ron Rider, "I suggested that 
they turn a trackball upside down, make it small, and use it as a mouse instead. 
Easiest patent I ever got. It took me five minutes to think of, half an hour to de¬ 
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scribe to the attorney, and I was done." (Pake, 1985). Apple Computer, Inc. rede¬ 
signed the mouse in 1979, using a rubber ball rather than a metal one. Variations 
on the ball mouse are what GUI users mostly mouse with today. 

The first computer system designed around the GUI was a Xerox in-house 
computer system called the Alto in the early 1970s. It had overlapping windows, 
used pop-up menus, and used the mouse. Around 1976, icons were added to the 
onscreen desktop. The research and design of the Alto system led to the first 
commercial GUI product, the Xerox Star, in 1981. The Star offered both tiled and 
overlapping windows and a menu bar for each window, and of course, the 
mouse. Xerox designers had a motto, "The best way to predict the future is to in¬ 
vent it." And they did! 

The Xerox Star was the first computer product to entertain the idea of the 
"desktop metaphor." The desktop metaphor is still the guiding metaphor for in¬ 
terfaces of the 1990s. A dictionary definition of metaphor is, "A figure of speech 
in which a word or phrase literally denoting one kind of object or idea is used in 
place of another to suggest a likeness or analogy between them." The use 
of metaphors in computer interfaces comes from trying to match the computer 
system to users' models. 

An early article (Smith et al., 1982) about the Star said, "Every user's initial 
view of Star is the Desktop, which resembles the top of an office desk, together 
with surrounding furniture and equipment. It represents a working environment, 
where current projects and accessible resources reside. On the screen are dis¬ 
played pictures of familiar office objects, such as documents, folders, file drawers, 
in-baskets, and out-baskets. These objects are displayed as small pictures, or 
icons." This is the beginning of the "messy desk" metaphor that now applies to 
computer screens across the world. 

The engineers at Xerox PARC were great at research and technology, though 
unsuccessful at commercial product development. The Xerox Star was never a 
success, even though over 30 work-years of work went into the product. The de¬ 
velopment of the first successful GUI computer systems was left up to Apple. 
The transition of research and technology to product development from Xerox to 
Apple was both a friendly and profitable one, as Xerox held 800,000 shares of 
Apple stock when it went public in December, 1980. 

Steven Jobs, a founder of Apple, visited Xerox PARC, got his team of de¬ 
signers at Apple excited about GUIs, and the rest is history. The Apple Lisa, the 
precursor to the Macintosh, came out in 1983 but was a false start. Like the Xerox 
Star, it did not succeed in the marketplace. It took the introduction of the Apple 
Macintosh computer in 1984, with a revolutionary advertising approach, to bring 
GUIs to the computer market successfully. Both the Lisa and the Macintosh had a 


Microsoft Windows: A GUI for the Masses 


165 



menu bar for the entire screen and the first pull-down menus in a graphical in¬ 
terface. An Apple designer received a patent for pull-down menus in 1984. 

Apple's success with the graphical user interface is legendary and still re¬ 
mains the most familiar example of GUIs. As I try to explain what GUIs are to 
unknowing listeners, I often have to say, "You know, it's like the Apple 
Macintosh." 


Would You Know a GUI If You Saw One? 


Figure 7-1 shows the evolution of the GUIs I've described here. After Apple's 
immense success with GUI development on the Macintosh, an operating system 
revolution was upon us, and both IBM and Microsoft went to work on PC-based 
GUIs of their own, along with a number of other software developers. 



Figure 7-1 . Evolution of the Graphical User Interface 
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Microsoft IBM, and others have had a lot of catching up to do and have had 
to do it on a hardware platform very different from the Apple Macintosh. One 
key advantage that Apple has is that they built the whole computer themselves as 
an integrated system. Their product design philosophy followed the Xerox PARC 
design methodology. Mike Jones (1992) describes how the Xerox Star was built. 
"Star began by defining a conceptual model of how users would relate to the sys¬ 
tem. The interface was completed before the computer hardware had been built 
on which to run it, and two years before a single line of product software code 
had been written." What a concept! What a way to design a product! Why aren't 
more products built this way today? 

The PC software development world doesn't have the luxury of the hard¬ 
ware and software environment at Xerox PARC and Apple. Personal computer 
hardware is developed independently by hardware manufacturers. Then soft¬ 
ware operating system and program developers build their systems to run on the 
various flavors and configurations of PC hardware systems. This is why users 
often wonder if PC hardware and software developers ever talk to each other. 
Users don't get the same feeling of a seamless integration of hardware and soft¬ 
ware as they do from the Apple Macintosh systems. Keep reading this book and 
I'll try to give you a better feeling about the GUIs and OOUIs represented by 
Microsoft's Windows and IBM's OS/2. 


KEY IDEA! 


What really makes up a graphical user interface? The best 
definition that characterizes a GUI is the phrase, "GUIs are WIMPs." What's that, 
you say? By WIMPs, I mean that GUIs are made of these elements: Windows, 
Icons, Menus and Pointing devices. If you look at a computer that has these el¬ 
ements on the screen and has a mouse attached, chances are you're looking at a 
GUI. 


Another acronym associated with GUIs is WYSIWYG. This stands for "What 
You See Is What You Get." In the (not so) old days, you would work with a word 
processing program or a graphics program and you'd have to print out your work 
to see what it really looked like in final form. Then you'd go back to the program 
to modify your document a little more and then print it again to see what it 
looked like. The computer screen just wasn't capable of presenting your infor¬ 
mation on the screen the way it would finally look on paper. Computer displays 
couldn't handle the text typeface fonts and point sizes. It also couldn't handle the 
colors, patterns, and complex graphics for a drawing program. 

Today's computer display technology allows software programs to show 
users exactly (or almost exactly) how their objects and information will look in its 
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final form if they were to print it. Hence, the term WYSIWYG. By itself, this dis¬ 
play and software technology doesn't require a graphical software product inter¬ 
face. However, a key aspect of GUIs is that users can see what their objects really 
look like, right on the screen. Therefore, WYSIWYG displays are an integral part 
of the whole GUI package. 

A final feature of GUIs is the ability for users to directly manipulate objects 
and information on the screen. An interface that just presents information 
graphically to users is not necessarily a GUI. I've seen many software adver¬ 
tisements proclaiming, "GUI Tool Depicts Real-Time Data!" One product stated 
that, "When linked to particular applications, the graphical user interface can be 
used to display the status of data as it changes in real-time mode." I would say 
that this product provides users with a graphical representation of their data, but 
does not necessarily provide a graphical user interface unless it contains other 
GUI features. An icon may be used to represent an object, but users must be able 
to do something with that object other than just look at it. Although there is a 
wide range of implementation of direct manipulation in interfaces today, this 
remains a key aspect of GUIs. 


Onward to the GUI-OOUI Battlefield 


Have the operating systems and interfaces available today achieved GUI-ness? 
Have they possibly even surpassed GUIs and moved on to OOUIs? One indica¬ 
tion of where these interfaces are today is how worried their competitors are. 

You can judge the success of new interfaces reaching some level of GUI-ness 
by Apple's concern over them. In March 1988, Apple filed a lawsuit against 
Microsoft for Windows 2.03 and Hewlett-Packard for their NewWave interface. 
The lawsuit filed by Apple claimed the interfaces infringed on Apple's copyright 
of the Macintosh graphical user interface look and feel. The lawsuit dragged on 
for four years and most of Apple's claims were finally thrown out in May 1992. 
This has opened the GUI floodgates and more and more product interfaces will 
be going GUI. 

The GUI revolution has now progressed to the point that Microsoft is even in 
danger of losing its grip on the product name Windows. Microsoft lost an initial 
bid in February 1993 to acquire a registered trademark for Windows. The United 
States Patent Office rejected the bid, stating that the word "windows" is a generic 
term, even in the personal computer industry. Competitors are obviously happy 
with the initial judgement. Here's an excerpt from the Patent Office's preliminary 
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decision: "The evidence clearly demonstrates that the public understands the 
term Windows to refer to a genus of goods, namely, computer software which 
utilizes windows on a computer screen...competitors' need to use the term to refer 
generically to the goods identified thereby outweighs the need of the applicant 
for exclusive rights to the term." Microsoft is appealing the decision. 

All of these events bring us to the computing environment we are facing to¬ 
day. What we have is a very heated and competitive debate over who has got the 
best GUI around, and an all-out war between GUIs and OOUIs for the hearts and 
minds of developers and users. Let's look at the main competitors in this war. 


A Brief History of Windows: No Pane, No Gain 


"We want people to use computers not because they have to, 
but because they want to. In short, we need to put the 
'personal' back into personal computers." 

Bill Gates, 1990 


IBM and Microsoft's historical relationship began with the development of the 
DOS operating system and has evolved into a Windows-OS/2 war. How did 
this current situation evolve between these two once-friendly and cooperative 
companies? 

Both companies realized the functional limitations of the DOS operating 
system and began efforts separately and together to extend and enhance the 
functionality and user interface of DOS. Both IBM and Microsoft continued work 
on DOS. Microsoft also began the development of Windows, a graphical exten¬ 
sion to DOS. In 1985, IBM and Microsoft also signed an agreement to define and 
build a new environment called Operating System/2, or OS/2. I’ll discuss Win¬ 
dows in this chapter and OS/2 in Chapter 8. 

Microsoft announced the development of Windows as a graphical extension 
for the DOS operating system in 1983. Bill Gates, founder of Microsoft, has esti¬ 
mated that it took some 80 work-years to design, code, and test Windows 1.0, the 
first version. Windows 1.0 did not actually ship until late 1985, and there's quite a 
story behind those two years of development. Figure 7-1 charts the evolution of 
the Microsoft Windows product since the first version became available in 1985. 
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Microsoft's goal for the Windows project was to build on the graphical user 
interface technology developed at Xerox PARC and championed by Apple Com¬ 
puter, Inc. Just as Apple's Steve Jobs was enlightened by a visit to Xerox PARC, 
Bill Gates also toured the Xerox PARC interface work and was turned on by the 
possibilities. 


Windows 3.0: The Bridge to OS/2? 


"We will introduce capabilities over time in order to bring the user 
community along without disruption. Each step will need to 
preserve compatibility. At each step we will work with independent 
software developers as we did when we developed Microsoft 
Windows and as we and IBM did when we developed OS/2." 

Bill Gates, 1990 


Windows 3.0 was originally positioned by IBM and Microsoft as a stepping stone 
to OS/2, which IBM and Microsoft were developing jointly. Windows' popularity 
was viewed as a positive sign that users would migrate along this path. John Ch¬ 
isholm ( COMPUTERWORLD , 1990) wrote, "Microsoft's purpose is not to con¬ 
solidate the two operating systems-Windows and OS/2 will coexist for a long 
time-but to facilitate market acceptance of OS/2, which has been slow. This rep¬ 
resents a perfect example of a company exploiting its existing strengths (the 
Windows applications base) in order to build a new business (OS/2). In effect, 
Windows 3.0 becomes an entry-level version of OS/2." 

However, Windows 3.0 became a smashing success behind Microsoft's 
enormous marketing efforts. Bill Gates gave the keynote address at the 1990 Fall 
COMDEX show in Las Vegas, titled "Information at Your Fingertips." Many of 
Gates' quotes I've used in this chapter come from this presentation (Gates, 1990). 
The popularity of Windows stymied interest in OS/2 and Microsoft decided to 
shift its operating system focus and strategy away from OS/2 and onto Windows. 

Everyone knew that IBM and Microsoft's relationship was strained. Both 
parties tried to paint a rosier picture than was generally believed. Steve Ballmer, 
a high-level executive at Microsoft, commented in an interview with Business 
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Week late in 1990, "You may not understand our marriage, but we are not getting 
divorced." On January 28, 1991, The Wall Street Journal reported that Microsoft 
was dropping its support of OS/2 to focus on Windows as the standard GUI en¬ 
vironment for DOS-based PCs. In response to these stories, IBM reaffirmed its 
commitment to OS/2 for both the short and long term. 

Even before Windows 3.0 was announced. Gates placed more emphasis on 
the Windows project and even moved programmers off the OS/2 project onto the 
Windows 3.0 development team. It wasn’t until 1991, however, well after Win¬ 
dows 3.0 was announced, that Gates and Microsoft publicly ended the marriage. 
They reported that Microsoft had shifted their focus to developing Windows as 
the premier GUI for the PC world, rather than as a migration step toward OS/2. 
At this point, the Microsoft-IBM divorce was all but signed and sealed, and the 
GUI-OOUI war was well on its way. 


KEY IDEA! 


Two good books to read for more information on the history 
of the Microsoft-IBM relationship are Hard Drive: Bill Gates and the Making of the 
Microsoft Empire (Wallace and Erickson, 1992) and The Design of OS/2 (Deitel and 
Kogan, 1992). Hard Drive is an easy-to-read biography of Microsoft's Gates, while 
The Design of OS/2 is a technical review of OS/2 that also covers the history of the 
DOS, Windows, and OS/2 products that IBM and Microsoft worked on both to¬ 
gether and apart over the past ten or so years. There's also a new book called 
Gates: How Microsoft's Mogul Reinvented an Industry and Made Himself the Richest 
Man in America by Stephen Manes and Paul Andrews (1993) that is interesting 
reading. 


Basics of a GUI: WIMPs and WYSIWYG 


"And then we need to connect them [users] to their work so easily 
that using a computer is as natural as picking up a pen or a pencil." 

Bill Gates, 1990 


As I discussed in Chapter 6, GUIs have finally evolved to the point where they 
are the current rage in user interfaces. Almost every PC magazine article and 
product advertisement boldly states, "Product ABC goes GUI!" This should lead 
readers and users to ask a few basic (but not simple) questions. What do they re- 
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ally mean, "go GUI"? What, exactly, is different from the non-GUI version of the 
product? The final question is one that can't be answered any other way than by 
using the product. You need to answer this question yourself or with the advice 
of others who have used the product. The big question is, "Even if the product 
did go GUI, how well-designed is the interface and does it fit the user's models 
and how users do their work?" 

Even the PC magazines have a hard time trying to define and measure 
graphical user interfaces. PC Magazine, in its September 12, 1989 issue, reviewed 
fifteen leading-edge GUI environments. In the introduction to their issue, they 
discussed the fact that it is very difficult to measure or test GUIs. "Reviewing all 
of these products in a single story was a challenge-partly because such tried- 
and-true PC Magazine evaluation methods as benchmark tests aren't appropriate 
for GUIs." Rather than try to benchmark the different GUIs, they "decided that 
the reviews should evaluate the strengths and weaknesses of each GUI; show 
how GUIs compare; advise on who should buy what, and when; discuss applica¬ 
tions developed for the GUI; and explain where each GUI is headed." This kind 
of careful examination must be done to compare and contrast GUIs. 

The basics of a graphical user interface are the integration of a number of el¬ 
ements that bring the tasks and work we do on the computer to life. In simple 
terms, a GUI is the graphical representation of, and interaction with, programs, 
data and objects on the computer screen. But it goes way beyond that. GUIs try 
to provide users with the tools and applications to do a task rather than a list of 
functions that the computer can perform. Windows really is what the technical 
term says it is, a visual and graphical environment for the DOS operating system. 
Let's just see what makes up this graphical environment. Figure 7-2 shows the 
Windows 3.1 interface as it might look on a user's computer screen. The illustra¬ 
tions of Windows 3.1 in this chapter are captured from OS/2 2.1's WIN-OS/2. 

The two most popular GUI acronyms, WIMPs and WYSIWYG, help define 
what really makes an interface a GUI. The PC Magazine GUI reviewers even 
asked Microsoft Corp. for their definition of a GUI. I've combined their list with 
other GUI features I've collected to come up with a list of features (Figure 7-3) that 
a software product or interface should have to be called a GUI. 

Even though many of the items on this list came from Microsoft, many GUIs 
today, including Windows, don't fully support all of these GUI criteria as well as 
they could, as critics are quick to point out. There is a wide range of "GUI-ness" 
on which an interface may implement many of the items on this list. In the end, 
users must choose the appropriate graphical interface for the operating system 
and programs they use, based on how products rate on users' own prioritized list 
of GUI criteria. 


172 


The GUI-OOUI War: Windows vs. OS/2 



Program Manager 


file Options Window Help 



Figure 7-2. Windows 3.1 User Interface (OS/2 Win3.1)* 


I'll mainly use Microsoft's Windows 3.1, which is a part of the OS/2 2.1 op¬ 
erating system, for examples and illustrations in this chapter. There are other in¬ 
terfaces that have varying amounts of GUI-ness, such as the DOS Shell and OS / 2 
1.3, but I'll focus on the Windows 3.1 GUI and its strengths and weaknesses. 
You'll also see some illustrations of other GUI examples. 


KEY IDEA 1 


Windows, as a graphical extension to DOS, mainly serves as a 
graphical window and file organizer and as an application launcher. It exhibits 
some GUI capabilities in this basic role, but the major GUI capabilities and tech¬ 
niques are mainly implemented by the many software products developed for 
Windows. This includes both products that are designed to enhance the window 
and file management in Windows, and the products that are specifically designed 
to run on the Windows platform. 


Microsoft Windows: 


A GUI for the Masses 


173 
















• A bitmapped, high-resolution computer display 

• A pointing device, typically a mouse 

• Promotes interface consistency between programs 

• Users can see graphics and text on their screen as it looks in print 

• Follows object-action interaction paradigm 

• Allows transfer of information between programs 

• Direct manipulation of on-screen information and objects 

• Provides standard interface elements such as menus and dialogs 

• Visual display of information and objects (icons and windows) 

• Provides visual feedback for user actions and tasks 

• Visual display of user/system actions and modes (menus, palettes) 

• Use of graphical controls ("widgets") for user selection and input 

• Allow users to customize/personalize interface and interactions 

• Allow flexibility for users to use keyboard or other input devices 


Figure 7-3= Features that Define a GUI 


Core User Skills Needed for GUIs 


"I think, therefore Icon. 

Jerry Zeidenberg, 1990 
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Something happens when DOS command-line or menu-interface users sit down 
and use a graphical user interface for the first time. User interface experts and 
journalists call it the infamous user interface "paradigm shift." However, to many 
character-based interface users, seeing a GUI and using a mouse for the first time 
is like going up a hill in a car and all of a sudden running into a brick wall that 
they never knew was there. The simple truth is that there is a learning curve as¬ 
sociated with moving into a GUI software environment. Let's look at what's in¬ 
volved in learning how to use a GUI. There is a basic set of skills and knowledge 
needed for users to conceptually deal with graphical user interfaces. 


Users Must Know the Underlying System Organization 

First, users must still have some knowledge of their computer system hardware 
and software configuration. The Windows environment and user interface do 
make it somewhat easier for users to work with their hardware and software. 
However, since the Windows environment still runs on top of DOS, it is very dif¬ 
ficult to hide the underlying system, directory and file organization from users. 
The Windows Guide (IBM, 1989a) states, "From the Windows environment you 
can easily access all Windows and non-Windows applications, files, directories, 
and disks, and control all DOS-related tasks such as directory or file management 
and formatting disks...You also should be familiar with basic Disk Operating Sys¬ 
tem (DOS) concepts, such as the role of files and directories." Figure 7-4 shows 
the File Manager, Windows' main way for users to view and manage their appli¬ 
cations and files. 


Users Must Understand Icons and Applications 

Users must know what the graphical objects that are on their screen represent and 
must know how to interact with them. The two basic objects users must learn 
how to use are icons and windows. Icons are used to graphically represent dif¬ 
ferent types of objects in the user interface. How many different icons are there in 
Figure 7-4 in the File Manager window and what do they represent? Figure 7-5 
lists the icons for each of the items in the Windows File Manager. 

First, there are different versions of folder icons for different types of direc¬ 
tories. According to the Windows Design Guide (Microsoft, 1992), the directories 
that contain the current directory (parent directories) should have an open folder 
icon. The current directory icon is represented by an open folder with shading. 
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Directories contained in the current directory are called child directories, and are 
represented by a closed folder. However, it doesn’t look like the File Manager 
uses the same folder icons that are defined in the Microsoft design guide. Differ¬ 
ent icons represent program files, document files, system or hidden files, and 
other files. Along the top of the File Manager window there are icons for each of 
the drives on my computer system, A through F. To use these icons effectively, 
users must understand the concepts of hierarchical directories in computer stor¬ 
age and the differences between different types of files, such as programs and 
data files. 

Icons also represent applications and windows in the Windows interface. 
For example, the File Manager application I just described is represented in Win¬ 
dows as an icon of a two-drawer file cabinet. This icon represents the application. 
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Figure 7-4. Windows 3.1 File Manager* 
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File Edit Bookmark Help 

Contend j Search ] Back | History |Gjossany| ' 


What Is File Manager? 

File Manager is a tool you can use to organize your files and directories. You can use 
File Manager to move arid copy files, start applications, connect to network drives, print 
documents, arid maintain disks. 

In File Manager, your files arid directories are displayed in a directory, vvindow. The 
directory window is split: the left half displays the directory tree, and the right half 
displays the contents of the current directory. When you select a different directory in 
the directory tree, the contents of that directory are displayed in the right half of the 
window. 

In the directory window, each filename has an ;on next to it, indicating what kind of 
file it is. 

CJ Directories. 

H Program files, PIFs, and batch files. These files start applications. 

B Document files. These files are associated with applications. When you choose 
a document file, the application starts and opens the file. 

B System or hidden files. These files have system or hidden attribuMs. 

D All other files. 

In the top left corner of each directory window are icons for each drive you currently 
have access to. These icons are called drive icons. Different icons represent the 
different types of drives on your computer: hard disk drives, floppy disk drives, network 
drives, RAM drives, and CD-ROM drives. You can change to a different drive by 
selecting its drive icon. 

To return to Contents for File Manager FHelp. choose the Contents button. 


Figure 7-5. Windows File Manager Icons* 


If the File Manager icon is in the WIN-OS/2 Main Window, it is just showing the 
application as a selectable application to run. If you run the application, you will 
open what Microsoft calls an application window. If the icon is on the desktop, 
however, the application is already running and is now a minimized window on 
that application. Other icons, like the WIN-OS/2 Main and Accessories icons, 
represent what Microsoft calls document windows. These are really just group 
windows that may contain applications. Figure 7-6 calls out the different types of 
icons that users must understand. 
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Figure 7-6. Windows, Applications, and Icons* 


Users Must Understand the Basic Elements of a Window 

Figure 7-7 shows the different elements of a window. Users must understand 
these basic elements to be able to manipulate windows themselves and the in¬ 
formation contained in the window. A window is made up of a window border 
or frame, a title bar, a control menu and menu bar, window sizing buttons, and 
scroll bars. More advanced window elements include the status bar, message bar, 
and control bars such as ribbons, rulers, toolboxes, and Palettes. All of these 
window elements are defined for developers in the Microsoft design guide. Users 
must learn about these elements, if they are present in Windows products they 
use, either by reading product online tutorials and help information or by reading 
the product documentation. 
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Figure 7-7. GUI Window Elements* 


Basically, users can perform the following actions on a window from either 
the keyboard or with the mouse: move, size, minimize, maximize, and restore. 
The main purpose of a window is to present information to users. A window like 
the WIN-OS/2 Main window may contain icons of applications that are available 
to users. The File Manager window presents other windows containing informa¬ 
tion on directories and files. 


Users Must Understand Graphical Interface Controls 

There are many graphical interface controls that users must understand to navi¬ 
gate among windows, to make selections, and to enter data. Figure 7-8 shows 
many of these controls in a dialog window. The Windows design guide groups 
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these controls into major sections: buttons, check boxes, list boxes, text boxes, 
read-only pop-up text fields, sliders, and static text fields. These controls should 
be designed to be intuitive for users to understand what they represent and how 
users can interact with them using either the keyboard or the mouse. The win¬ 
dow elements I discussed, such as menu bars, scroll bars, and window sizing 
buttons are also graphical controls that users must understand. 


Users Must Understand How to Use a Mouse 

Children have no trouble learning how to use a mouse on a computer. Most kids 
have finely tuned motor skills and hand-eye coordination developed from years 
of arcade and video games, such as Nintendo™. Adults on the other hand, usu¬ 
ally require some instruction and take some time learning how to use the mouse. 
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Users must understand that the mouse moves the pointer on the screen and 
whatever buttons they press on the mouse will perform some action depending 
on the location of the pointer on the screen. The mouse is used to manipulate 
icons, windows, and data on the screen by pointing, clicking, dragging, and even 
double-clicking with the mouse buttons. 

I'll cover mouse interaction techniques in detail later in this chapter, in the 
section. How Users Interact with GUIs. 


The User Interface Architecture Behind GUIs 


In Chapter 4 on interface guidelines, I discussed the intertwined relationship that 
Microsoft and IBM had in the development of the CUA user interface architec¬ 
ture. The Windows 3.0 and 3.1 interface and the products designed for Windows 
all basically follow the CUA '89 user interface architecture design guidelines 
(IBM, 1989b). The interface design architecture detailed by CUA '89 was called 
the graphical model, where many applications share the screen using windows 
rather than each application using the full screen. Microsoft (1992) subsequently 
published its own version of their GUI guidelines for Windows developers. 


A Key to GUI Design: The Object-Action Sequence 

One of the key concepts of the CUA '89 user interface model was the object-action 
approach to user-computer interaction. This means that users first select an object 
and then select an action to perform on that object. This applies to all objects in 
the interface, including icons, windows, and items within windows. When de¬ 
signers consistently support an object-action approach to user interaction, the 
user's conceptual model of the interface is constantly reinforced. The alternative 
is the action-object approach, which has been used by most command-line inter¬ 
faces and many menu-driven interfaces in the past. 

In the graphical interface arena, objects are the main focus of the users' at¬ 
tention. Most objects that users work with can also be composed of sub-objects. 
For example, a spreadsheet is an object that users can edit, copy, and print. A 
spreadsheet is also composed of individual cells that also can be edited, copied, 
and printed. The object-action approach allows users to use consistent and fa¬ 
miliar techniques for all levels of objects. Figure 7-9 shows a typical object-action 
process sequence. 
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Once the objects and sub-objects have been determined for a product, actions 
can modify or manipulate the properties and settings for objects. Each type 
of object has appropriate actions that can be applied to each object of that type. 
For example, most window objects can be manipulated by the sizing and moving 
actions, while a spreadsheet object can be saved, copied, and printed. 

How do users follow an object-action sequence? For example, to size a par¬ 
ticular window on the screen, users select an object (the window) simply by 
clicking the mouse anywhere on the window or inside the window. Once the 
window is selected, the frame is sized directly by dragging the frame with the 
mouse, or by selecting one of the window sizing actions from the control menu. 

The object-action process sequence has numerous advantages. An object, or 
objects, in a window can be selected, and then the menu bar actions and routings 
can be browsed to see which items apply to the selected items. Users can perform 



Figure 7-9. Object-Action Process Sequence* 
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a series of actions on the same object without having to repeatedly select the ob¬ 
ject. This object-action sequence can be performed with the mouse via direct 
manipulation and using menus. The object-action sequence can also be followed 
from the keyboard by using menus. 


A Drawback to GUIs: Application-Orientation 


One of the drawbacks, or limitations, of the Windows graphical user interface 
environment and the products developed on the Windows platform is their 
application-orientation. Software development today is mostly somewhere in- 
between the GUI application-oriented world (as defined in CUA ’89) and the 
OOUI object-oriented world of CUA '91 that I'll discuss in the next chapter. 


KEY IDEA! 


One of the advantages of the Windows graphical environment 
is that users see information on the screen. Users may also get the idea that they 
are really working with objects. However, in a GUI environment, users focus 
primarily on applications. Users select an application they want to run and then 
specify the data file they wish to use. Users also organize applications and data 
on their computer using graphical tree structures using drives and directories (the 
File Manager application). Icons are simply graphical representations of applica¬ 
tions, data, and minimized windows (Figures 7-5 and 7-6). Users must still un¬ 
derstand how applications work and must know where files and data that are 
needed by the application are stored in their computer system. 


Let me explain more about the application-oriented approach. First, users 
must start an application before doing most of their work with files. File organi¬ 
zation actions such as moving, copying, and deleting files may be performed 
from the File Manager or even from the DOS command-line. All other task- 
specific actions cannot be performed on the contents of a file unless an application 
is started and the file is brought into the application. 


BUMrt How can you tell if the products you are working with are 
application-oriented? First, double-click your left mouse button on an icon and 
see if it opens into a window. If the main part of the window (the "client area" in 
programming terms) is blank and you have to select File and Open... from the 
menu bar and pull-down menu, then you have an application-oriented product. 
To avoid this "empty window" phenomenon, Windows and other GUI s allow 
users to associate different types of data files with specific applications. Then us- 
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ers may double-click on a data file icon and the system will automatically invoke 
the application and bring the data file directly into the application window when 
it is opened. This allows users to bypass the File and Open... menu bar technique 
if they have direct access to the data file icons in the File Manager window. 

Another way to tell if you are working with an application is to look at the 
title bar of an opened window. The title bar provides information about where 
the window came from and what is contained in the window. The title bar of an 
application window shows a small icon for the application, the name of the ap¬ 
plication, and the name of the object or file. When users change files, the name in 
the title bar changes. 

If you have to explicitly save the changes to your data, you've got an 
application-oriented product. If you have to close the product window once 
you've finished with your data files, you've got an application-oriented product. 
If you have to do your work the way the product requires you to, rather than the 
way you would rather do it, the application is in control, not you! Finally, if you 
have to get trained or educated on a specific product to learn how to work with 
your data with that product, you've got an application-oriented product. 

Most of what users see in the Windows environment are mainly 
application-oriented interfaces. However, some object-oriented techniques are 
being implemented by the applications themselves that are developed on the 
Windows platform. For example, several Windows word-processing applications 
now enable users to select a piece of text and then drag it to another location in a 
document using the mouse. This embodies both the object-action process and an 
object-oriented approach to working with text objects within a document file. 
Newer word-processing applications also allow users to work with different 
types of data other than text, such as graphics and images, within a document. In 
the next chapter. I'll show you more examples of object-oriented products. 


The Application-Oriented Menu Bar 

Users work with applications in windows that have a menu bar. The menu bar 
contains routing choices that display pull-down menus when selected. The 
pull-down menus contain action and routing choices that relate to objects in the 
window or the application that is represented by the window itself. The main 
groupings on application menu bars are File, Edit, View, and Help. The CUA 
guidelines (IBM, 1992) and Microsoft (1992) guidelines offer standard menus for 
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developers to follow to ensure that users are given a common and consistent 
menu structure across applications. 

The File pull-down menu is used for applications that use data files. The 
menu choices provide the commands users need to manipulate objects as a 
whole. The standard actions allow users to open, create, print, and save files. The 
Exit action is also in this menu, and is always placed at the bottom position of the 
pull-down. 

The Edit menu provides actions to manipulate or reorganize information in 
the window. Standard choices include undo, cut, copy, paste, clear, and delete. 
These actions apply to many types of information and objects. Any applications 
that support the manipulation of data, text, or graphics should use these standard 
Edit actions. 

The View menu allows users to select different ways to look at information 
or objects in the window. These actions only change views, they do not change 
the data itself. Items in a View pull-down might offer draft, WYSIWYG, or out¬ 
line views of text. Tool and color bars and palettes might also be displayed or 
hidden with selections in the View menu. Sorting actions such as include, sort, 
and refresh would also appear in the View menu. 

The final menu grouping on the menu bar is the Help choice. This pull¬ 
down allows users access to various forms of help information. Typical choices 
include a help index, general help, help for help, a tutorial (if provided), and 
product information. 


K E Y IDEA! 


These menu groupings are defined by the interface guidelines 
because they are common actions and routings that apply across many applica¬ 
tions. Designers and programmers who follow standard menu conventions allow 
users to transfer their knowledge of menus from one application to others, even if 
the applications and data are very different. This supports the design principles 
I've discussed earlier. 


Applications may also implement graphical icon bars, commonly called tool 
bars, to provide quick and convenient access to application actions and dialogs. 
Microsoft categorizes these controls as control bars in their design guide. Most of 
the popular GUI word-processing applications and graphics packages use tool 
bars extensively. The tool bar is usually located directly under the window menu 
bar, although it can be located anywhere in the window or in a separate window. 
Many of the applications I've used as examples in this chapter use tool bars. 
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GUIs and the User's Model 


"GUIs have made machines more people-literate rather 
than forcing end-users to become more computer-literate. 
What does this mean to you? More user-friendly!'' 

Jeff Tash and Richard Finkelstein, 1993 


Graphical user interfaces have the capability of bringing user's conceptual models 
to life on the computer screen if products are well thought out and well-designed. 
As I discussed in Chapter 2, GUIs can also educate and entertain as well as help 
users do their work. Look again at The Playroom's interface in Figure 7-10. Like 
Windows, The Playroom is a graphical environment for a variety of objects and 
applications. The Playroom defines the metaphor that all of the applications will 
follow and allows users to build a consistent conceptual model that should be 
followed by all applications. Does Windows or your GUI do as good a job of 
building a real-world metaphor for you? Does Windows or your GUI allow you 
to build a consistent and usable conceptual model that works for all of the appli¬ 
cations you use? 


Do GUIs Hide the System from Users? 


KEY IDEA! 


As I said earlier, Windows is really the graphical shell, or 
desktop that enables users to manage their computer system's drives, directories, 
and files, and organize and run their applications. In this role, since the tasks are 
those of managing a computer, there is little of the system that can be hidden 
from users. Also, it is difficult to stray too far from a computer metaphor, since 
those are the types of tasks done at the Windows level. Individual applications 
have the freedom to develop the appropriate models and metaphors for their 
particular users and tasks. 


The Playroom, for example, is a graphical program that doesn't have to 
worry about any computer system concepts. Its developers built the entire pro¬ 
gram around a familiar and friendly real-world metaphor and have hidden all of 
the complexities of the mputer from their users. This also applies in some re- 
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Figure 7-1 0 . Hiding the System in The Playroom 


spects to more industrial-strength business applications that can build their own 
metaphors, but also must rely on the user's knowledge of computer concepts of 
programs and files. 

The Windows system management applications, like File Manager and Pro¬ 
gram Manager, must provide a graphical interface to somehow handle the com¬ 
plex computer tasks that may not be intuitive or familiar to users. As such, they 
are often the target of user frustration and are a target for the software competi¬ 
tion. Peter Lewis (1993) says, "Windows makes software easier to use, at least in 
contrast to the clunky DOS programs that tens of millions of PC owners still use. 
But Windows is no beauty. Its methods of handling and maintaining files are 
relatively awkward." There is even a software product called Windows Tip-A- 
Day that you get free if you subscribe to the magazine, Windows Tips & Tricks. The 
popularity of Windows and the GUI environment has provided fertile ground for 
a growing number of products that are specifically designed to improve the func¬ 
tionality and user interface for pieces of Windows itself. Michael Elgan (1993) 
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began his monthly column with, "You may have already found out the hard way 
how to make Windows play dead. But you can also train Windows to do useful 
tricks." 

Windows Magazine (Methvin and Vizachero, 1993) reviewed seven desktop 
managers that replace the Windows Program Manager and File Manager. Their 
reasons for this review were, "Program Manager and File Manager seem to be the 
eternal whipping boys for Windows users. Perhaps it's because they're the first 
thing you see in Windows-maybe it's because they're just good enough to use but 
not great enough to love...Not surprisingly, vendors have been happy to build a 
variety of interface replacements and enhancements that do a variety of things 
better, faster or easier." 

There's one product. Dashboard, that even uses a car dashboard metaphor to 
let users do their system management tasks. There are lots of buttons, gauges, 
and dials that perform tasks and show system feedback. I don't know if this 
"metaphor on top of a metaphor" approach really works for users. You'll have to 
try it yourself to find out. 

Other products strive to allow users more flexibility in organizing their 
computer interface into more real-world desktops that more closely match the 
real-world office metaphor that is commonly used for computer interfaces. One 
of the descriptions commonly attached to GUIs is the messy desk metaphor. This 
describes the ability of GUIs to open applications into multiple windows on the 
screen that can overlap each other and look like the messy desk in your office! 


KEY IDEA! 


Some products recognize that one GUI audience, the novice 
user, needs even more help than Windows, or the other products I've mentioned, 
provide. A product called WinDesk targets novice Windows users with a univer¬ 
sal icon feature that can be used across the broad array of Windows programs. 
The goal of the product is to make it easier for novices to use Windows without 
eliminating the GUI environment's other features and customizing capabilities. 
WinDesk is a scaled down version of the company’s full-featured Windows 
product, WinTools. I bring this up as a reminder that product designers and de¬ 
velopers should also focus on the range of users for their environment, in addi¬ 
tion to providing better products and tools for experienced users. 


GUIs and Real-World Metaphors 

Let's take a look at how GUI products can build interfaces that match user's con¬ 
ceptual models for the tasks they want to perform. One of the hot software 
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product areas these days is the Personal Information Manager, or PIM. PIMs 
typically provide integrated services such as an on-screen calendar, to-do list, 
planner, phone and address book, appointments, and other organizer functions. 
Many of us have hardcopy planners, calendars, and appointment books that we 
carry with us. These software products attempt to provide better and more 
powerful functions and an easier interface than we are used to in the real world. 

One popular PIM is Lotus Organizer, a product made for Lotus by a small 
company, Threadz Limited. Lotus needed to get a PIM to market quickly, so they 
bought a good product from another company, improved it, and began to market 
it extensively. Organizer is now one of the most popular Windows PIMs on the 
market today. The model used by almost all of the PIMs is the one we are all fa¬ 
miliar with-the hardcopy manual organizer and appointment book. By following 
the real-world metaphor closely, these products can offer users easy-to-learn and 
easy-to-use interfaces that can make using an on-screen organizer worth the ef¬ 
fort. Figure 7-11 shows one view of the Lotus Organizer product. Notice the ex¬ 
tensive use of the icon tool bars, both horizontally under the menu bar and along 
the left side. Can you figure out what each of these icon button represents? 

One of the secrets of a PIM's success is its use of the power of the computer 
to keep track of information in multiple places for multiple purposes. For ex¬ 
ample, my wife Edie's birthday is July 16th. I need to type this information only 
once, in the anniversary section of the organizer. The product automatically 
places that information in the calendar section on the page for July 16th for every 
year in the calendar. This feature shows how to utilize the strengths of the com¬ 
puter to help in areas where we have weaknesses, such as remembering birthdays 
and anniversaries. OK, I'll admit it, the awful truth is, I forgot my mother's 
birthday while I was deep in the throes of writing this book. Had I been using a 
PIM, I might not have forgotten to send her a card and a present. Remember the 
chart of human and computer strengths and weaknesses that I described at the 
end of Chapter 2? This is one example of designers and developers using that 
chart to enhance a software interface. 


KEY IDEA! 


Even though Lotus Organizer successfully follows a meta¬ 
phor that is consistent with users’ models of their world, a metaphor can be taken 
too far. Just because you can flip to the inside back cover of your regular orga¬ 
nizer doesn't mean that users need to be able to do that on the computer. It may 
seem realistic, and even cute, but there is nothing that users can do on this page, 
so why even include it in the organizer? This and a few other features have 
caused some reviewers to comment that the product imitates the real-world 
metaphor of the organizer too slavishly. There is a lesson to be learned here for 


Microsoft Windows: 


A GUI for the Masses 


189 



Figure 7-11 . Real-World Metaphors in Lotus Organizer 


designers and programmers: Don’t follow a metaphor just for the sake of consis¬ 
tency. Use metaphors where they work and allow users to perform actions and 
tasks easily on the computer. If there are faster or better ways to present infor¬ 
mation to users or to allow them to interact with a program, don’t tie them too 
closely to the metaphor. Don’t let the metaphor slow users down or force them to 
do tasks in too structured a way. 

One final note on using real-world metaphors. If you use a metaphor, don’t 
bend it too far or break it. The Organizer has an icon of a wastebasket in the 
lower left-hand corner of the screen. When you drag an entry to the wastebasket, 
you see a bright red burst of flames as your entry is incinerated. Do you think 
you can get that entry back? Well, according to your model of what happens to a 
real piece of paper when it is burned to a crisp, you wouldn't think you could re¬ 
trieve the entry. However, computers have the wonderful capability of undoing 
previous user actions, if so programmed, so Organizer allows you to undo the 
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drag-to-the-wastebasket action. The cute flaming wastebasket icon contradicts 
the tasks users can perform, so the visual cuteness and feedback ends up backfir¬ 
ing and causing user confusion regarding the user interface. 

Here's another reminder. Even though a product like Lotus Organizer offers 
a good metaphor for users to work within, it is still an application-oriented 
product. When Organizer is opened, a blank window lets users know that they 
have to select an Organizer file to open to do their tasks. Here the Organizer 
metaphor doesn't quite fit. Users must keep separate files for different organiz¬ 
ers. They can't combine, say, two different sets of anniversary dates in the same 
organizer. Remember, most GUIs products are still application-oriented. Unfor¬ 
tunately, users aren't "application-oriented", computers are! 


GUIs and Graphical Controls 

Graphical controls allow users to make choices, set values, and initiate actions 
within a product. Controls range from buttons, check boxes, and entry fields for 
individual selections, to containers and notebooks that serve to organize objects 
and information for users. These controls must be designed and used to fit the 
user's model and the particular metaphor with which users are working. The 
usage of these controls must also be consistent across programs and GUI envi¬ 
ronments. Users will get very confused if a button does one action in one pro¬ 
gram and does something very different in another application. 

Controls are basically designed after real-world, physical devices you use 
every day. Take a look at your television, stereo system and VCR and you will see 
the interface controls that GUI controls are based on. Figure 7-12 lists the controls 
that are now fairly standard across the different GUI and OOUI environments. 
Note that menus can be categorized as graphical interface controls. You'll see 
most of these controls shown in the illustrations I've used throughout the book. 
Well-designed and well-implemented graphical controls foster consistency with 
the controls users are familiar with in their non-computer environment. 

Tool vendors provide these controls for developers on the various GUI plat¬ 
forms if they are not already available in the GUI developer tool kits. For ex¬ 
ample, IBM's Common User Access (CUA) Controls Library/2 provides a set of 
reusable user interface components that were originally developed for the OS/2 
2.0 interface environment. To foster consistent interface development and to help 
migration efforts from earlier GUIs, IBM developed the controls so that they 
could be used in the OS/2 1.3 and Windows 3.0 and 3.1 development environ¬ 
ments. These controls include the slider, value set, spin button, container, and 


Microsoft Windows: 


A GUI for the Masses 


191 



notebook. Standard file and font dialogs containing multiple controls are also 
provided to allow developers to build standard dialogs for user interaction. 


KEY IDEA! 


To see how strongly interface controls can be used in support 
of the user's model and the product metaphors, take another look at Lotus Orga¬ 
nizer in Figure 7-11. The entire product is built around the organizer book meta¬ 
phor, which is implemented on the screen using a type of notebook control. Users 
should have little trouble figuring out how to use the computer notebook, since 
they already know how to use a hardcopy spiral or three-ring binder. This one 
interface control establishes the product metaphor and enables users to learn and 
use the product interface quickly and easily. 


• Entry field 

• Menu bar 

• List box 

• Pull-down menu 
® Spin button 

• Cascaded menu 

• Push button 

» Pop-up menu 

• Radio button 

• Tool palette 

• Value set 

• Tear-off menu 

• Check box 

• Container 

• Scroll bar 

• Notebook 

• Slider 

• Drop-down list 

• Combination entry field/list box 

• Drop-down combination box 


Figure 7-12. Graphical Controls Used in GUIs and OOUIs 
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Customizing GUIs 


I've stressed that user customizing is one of the key interface design principles. 
For a graphical environment like Windows, there are many elements that users 
can change, such as background and window colors and fonts, mouse and key¬ 
board settings, and even system sounds. The question is, where do users make 
these system changes? 

In an application-oriented environment, users must figure out where these 
system customizing settings are hidden. For example, do you know how to 
change the system time and date with your GUI? Can you do it directly with the 
clock icon on the screen? Probably not! You must first find the Windows Control 
Panel located in the Main Group. Open the Control Panel and you'll see the 
Date/Time icon. Double-click this icon to open the window and finally you can 



Figure 7-13. Customizing with the Windows Control Panel* 
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change the time and date. Within an application-oriented environment, users 
must know how the interface organizes functions and tasks and they must know 
where to go to find the application that does these tasks. Also, users can only 
open up one of the mini-applications in the control panel at a time. Figure 7-13 
shows the navigation users must follow to customize the system date and time. 
I'll contrast this with the way an OOUI allows you to customize your system ob¬ 
jects in the next chapter. 


GUIs and the Multiple Document Interface 

Windows follows the multiple document interface (MDI) model, where an appli¬ 
cation manages multiple applications or windows within that application. The 
MDI model allows users to manage multiple objects, or multiple views of the 
same object, within the main application window. This provides task manage¬ 
ment automatically for users. Figure 7-14 shows an example of the MDI window 
model used in the Windows interface. 

Open windows and objects in the main application window share the menu 
bar and also must appear within the borders of the main window. Contained 
windows cannot be moved or sized outside of the main window and are clipped 
if the main window is reduced. Although this method allows some degree of task 
organization, it is rigidly structured by the application and forces users to work 
with a number of windows within a very small piece of real estate on the com¬ 
puter screen. The OS/2 object-oriented interface provides task organization 
without the restrictions of the MDI model. I’ll discuss this in the next chapter. 


GUIs and the Iceberg Chart 

Let's wrap up this section on GUIs and the user's model. I've spent lots of time 
looking at how Windows and Windows products support the user's model in the 
GUI environment. By now you should know that a usable GUI product is more 
than just a bunch of windows, buttons, and colors on the computer screen. There 
is a great difference between a graphical interface and a human interface! Many 
products have "gone GUI," but few have gone all the way to building a usable 
and familiar human interface for their products. 

This goes back to my discussion of the iceberg chart (Figure 2-6) in Chapter 
2. A basic GUI gives you little more than the look (only 10% ) and the feel (only 
30% ) of the designer's model of a GUI. The key to a successful GUI (and an 
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Figure 7-14. Windows MDI User Interface* 


OOUI, also) is how well it addresses the human aspect of the interface. This is the 
more important part of the iceberg (60%) that addresses how the design of a 
product and its metaphors relate to users and their conceptual models. 


GUIs and Users' Memory 


Any well-designed software user interface should reinforce the design principles 
that reduce the users' memory load. Graphical user interfaces have the additional 
advantage of being able to provide very visual cues and information that use the 
computer's information storage and retrieval strengths to offset human memory 
limitations. Do you remember all of the DOS commands I listed in Chapter 6? 
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Should you have to remember these commands in a GUI environment? The an¬ 
swer to both questions is an emphatic NO! 

Menus as GUI Memory Aids 

The extensive use of menus is critical to the success of GUIs. I discussed the ad¬ 
vantages of menus in Chapter 6 and mentioned that they would play a key role in 
GUI interfaces. Even though there may be a wide range of graphical interfaces 
available to you as a computer user, menus are probably one of the main elements 
implemented in all of them. Graphical menus should be provided for numerous 
areas of GUIs, including windows and icons. 

The menu bar, with its pull-down menus and cascaded menus, provides a 
consistent and familiar place for users to browse through all of the actions and 
routings available in an open window. The menu bar allows users to recognize 
actions rather than having to recall the appropriate actions from memory. 

The power of the menu bar is tied to the object-action process sequence. 
Users first learn the sequence of selecting an object, or objects, in the window and 
then selecting an available choice from the menu bar. The menu bar additionally 
provides contextual information by changing dynamically depending on the cur¬ 
rent contents and selections in the window. Choices in pull-down menus are 
grayed out (called unavailable emphasis) if they are currently unavailable, based on 
selected items in the window. Choices that are never available to users, based on 
their job function or access level, should not be shown in the menu bar. Figure 
7-15 shows an object-action sequence and the menu bar in a window. 

Many products don’t take full advantage of the benefits of the 
menu bar. Dynamically showing appropriate choices and emphasizing currently 
available choices for selections provides users with a means of exploring the 
product interface. The menu bar visually highlights the relationships between 
objects, selections and actions in the window. It is important to show choices that 
may be appropriate, yet are currently unavailable. There are two reasons for still 
showing currently unavailable menu choices. First, for consistency, so users al¬ 
ways know, for example, that the Save as... choice is always listed in the File 
pull-down on the menu bar. Secondly, it allows users to get help on a menu item 
even though it may not be currently available. 

Menus also help user's memory by chunking actions and menu choices into 
logical and meaningful groups within the menu bar. Once users are familiar with 
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Figure 7-15. Using Menus in GUIs* 


the menu bar in one application window, they can transfer their understanding of 
where common actions are in the menu bar to another application window, even 
if the applications are very different. This reinforces the principle of making the 
user interface consistent and provides users with the continuity of menu bar 
groupings across applications. This is why the IBM, Microsoft, and Apple design 
guides define standard menu bar groupings such as File, Edit, and Help. A 
standard menu bar structure provides a memory aid to users that reduces the 
need to remember where to go to find the actions and choices needed to do a task. 
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Interface Controls as GUI Memory Aids 

As I discussed in the last section, graphical controls allow users to make choices, 
settings, and initiate actions at the interface. One of the most important and cre¬ 
ative aspects of interface design is deciding what controls to use in the interface to 
best allow users to do their work. Many of the graphical controls provide infor¬ 
mation in the form of lists or choices to reduce the amount of information users 
must recall. Other controls, such as the entry field, force users to remember in¬ 
formation and type information correctly. 

For example, when asking users to set information as simple as the time, 
don’t force them to type in a.m. or p.m., when you can provide radio buttons with 
the two choices. When users are filling out forms, don't force them to type in in¬ 
formation where the computer already knows the list of valid entries. If a data 
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This is a TrueType font. This same font will be used 
on both your printer and your screen. 
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field requires the abbreviation for a state in the U.S., allow users to type in TX for 
Texas if they already know the abbreviation. In addition, also provide a scrollable 
drop-down box that lists all of the state abbreviations so users don't have to even 
try to remember all of the state abbreviations. This same strategy applies to any 
set of choices, such as fonts, point sizes, colors, patterns, and so on. 


Visual Feedback as GUI Memory Aids 

The strengths of high-resolution displays and graphical interfaces should be used 
to provide memory aids to users during their work tasks. Status areas and in¬ 
formation areas have been defined as window elements and should be used to 
keep users informed of activity within a window. 
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Arranging Windows and Icons 

Using Program Manager commands, you can arrange your desktop so that wim 
and icons are easy to see. The Tile command resizes and arranges the open gr 
windows side by side in the Program Manager window. The Cascade commanc 
resizes and layers open group windows so that each title.bar is visible. 


title bar 

The horizontal bar (at the top of a window) that contains the title of the window or 
dialog box. On many windows, the title bar also contains the Control-menu box and 
Maximize and Minimize buttons. 
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You can also specify that WIN-OS/2 rearrange the program-item icons in agrou 
window whenever you change the window's size, add items, or move items. 

To rearrange program-item icons 

► From the Options menu, choose Auto Arrange. 

A check mark next to the command means it is in effect. 
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Figure 7-17. Visual Feedback in GUIs* 
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A status area should be used to provide information regarding the state of 
the application or the information within the window. For example, if informa¬ 
tion in the window has been sorted or filtered, some feedback like "Showing 140 
of 268 matching items at 10:15 A.M. on Monday, April 26, 1993" should be dis¬ 
played in the status area. The information area can be used to guide users or 
provide information about an item in the window or on a menu. For example, if 
the keyboard cursor or mouse pointer is on the File Open... menu bar choice or 
on the Open icon on the tool bar, the information area might state "Opens a 
document." This type of information reinforces learning of the interface and al¬ 
lows users to rely on the system to provide helpful reminders about appropriate 
actions rather than having to remember what every menu item or icon in the in¬ 
terface means and does. 

Some GUI operating systems and programs have taken the information area 
concept and made it more dynamic. In some Windows applications, clicking 
mouse button 2 (usually the right button) on an item pops-up a small window 
with some information or help text. This is called balloon help. 

There are many other visual techniques that serve to remind users of modes 
they are in or the current state of the system. For example, the mouse pointer 
should change dynamically to show the actions available, currently in use, or the 
status of an application or system process. The mouse pointer can show window 
sizing information, object manipulation information, text entry locations, a do- 
not-drop indicator, and a wait pointer to show that a lengthy process is under¬ 
way. All of these visual indicators are subtle, yet important, reminders to users of 
the context of their actions. If users are distracted and look away or leave their 
computer for a time, there should be some visual indicators on the screen when 
users get back to let them know where they were when they left their task. 

There's one more area where interfaces should do a better job of informing 
users and relieving their memory. Operating systems and programs have been 
notoriously bad about letting users know what step they were at in a lengthy 
process such as installing or updating the system of programs. Many GUI prod¬ 
ucts used to have a very non-GUI installation interface, where users had very 
little idea where they were in the process and what was expected of users next. 

Many GUI programs have finally improved their installation interfaces to 
show the steps in the install sequence, such as "Now installing Disk 1 of 3." They 
are also using graphic controls to remind users that something is actually hap¬ 
pening and that everything is running smoothly. I installed a program last week 
and suddenly realized halfway through the install process that I had selected the 
wrong drive as the target for the program installation. The only way I realized 
this was that while it was installing, the interface let me know where in the corn- 
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Figure 7-1 8 . Interfaces for Installing GUI Programs* 


puter it was installing the program. Only then did I realize that I had made a 
mistake. I had forgotten which drive I had chosen and I wouldn't have noticed I 
made a mistake unless the program had reminded me. That's the kind of inter¬ 
face design that makes users feel comfortable using a computer. 

Progress indicators may be graphical, animated, or even textual, as long as 
they show progress in terms users find meaningful and informative. Progress in¬ 
formation may be shown as percentage completion, time completion, or number 
of items already installed and how many are left to install. Be sure to let users 
cancel the process underway if they decide not to continue the process for what¬ 
ever reason. 
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The Semantics of GUIs 


Some of the goodness of graphical interfaces ends up also being some of their 
most dangerous aspects. Every control, every icon, each color, all emphasis, 
screen animation, and sound should have some meaning to users and should 
serve some purpose in support of users performing tasks with an operating sys¬ 
tem or program interface. Semantic feedback is a reminder to users that an object 
has some meaningful characteristic or an action is being performed that has some 
meaning to users. 

I've already discussed the relationship between GUIs, interface metaphors 
and users' real-world models. Careful use of metaphors allows users to build 
meanings and expectations based on visual and graphical elements of the user 
interface. Things that look alike on the screen should behave alike. Icons that 
look like folders should behave like folders. Things that are highlighted in the 
same color should have some relationship to each other. Make sense to you? 
Sure it does, but that doesn't mean designers and developers think enough about 
the meanings users will associate with the interface elements they design and 
build. 

Think back on the flaming wastebasket and the undo action I described in 
the Lotus Organizer product. It may seem minor, but these semantic mismatches 
between interface elements, their expected behaviors, and their actual behaviors 
undermine the comfort users feel with the interface and lessen the confidence 
they may have in their ability to understand and use a product. 


Drag and Drop: What Does It Mean to Users ? 

Because GUIs promote directly manipulating objects and other interface ele¬ 
ments, semantic feedback is often combined with the syntactic feedback I'll dis¬ 
cuss in the next section. For example, users can drag an object such as a text 
document to a printer or a wastebasket. The meanings associated with the same 
direct manipulation technique causes very different actions to take place. Let me 
explain. There's a lot happening at the interface level for every seemingly simple 
drop-and-drag action. 

When users drag an object, they should get some visual feedback that the 
object has been grabbed and they are doing something with it. This is called 
source emphasis. Also, when users grab an object and drag it, some default action 
is assumed. In most interfaces, the default action is the move action. In some 
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graphical operating systems, such as Windows and OS/2, the mouse pointer ac¬ 
tually can reflect the meaning of the drag operation. When users drag the docu¬ 
ment over the wastebasket icon, there should be some visual feedback that this 
object accepts the dragged object. This is called target emphasis. After users re¬ 
lease the document on the wastebasket, the action is complete. Look on the 
screen where the document was originally. Is it still there? Hopefully not, since it 
was just thrown away in the wastebasket. 

Halfway through this scenario, let's say our users decide to print the docu¬ 
ment instead of throwing it in the trash. The same mouse action technique is 
used, but instead of dropping the document on the wastebasket icon, they decide 
to drop it on the printer icon. OK, no problem, you say, that is a valid action. But 
printing a document is very different than deleting a document. Deleting an ob¬ 
ject means the object is moved from its original location to some other location, in 
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this case, the wastebasket. The meaning of the action is different when an object 
is dragged to the printer. The original object is not being moved or deleted, it is 
actually being copied to the printer. That means the object should remain where it 
was on the screen after it is dropped on the printer. The copy is now being 
printed and all is well in the interface. 

The subtle, yet important, difference in the meanings of these two similar 
direct manipulations should be communicated to the users. Windows File Man¬ 
ager and the whole OS/2 Workplace Shell interface both change the mouse 
pointer from the move pointer to the copy pointer when an object is dragged over a 
device object like the printer, which won’t accept the move action, only the copy 
action. A similar situation applies when an object is dragged to a different disk 
drive, which is assigned as a copy action rather than a move as the default. 

Both the Windows and IBM's CUA user interface design guides recommend 
that designers should provide a way to override the default interpretation of the 
drag operation by using modifier keys in conjunction with dragging. Flowever, 
the Windows guide only recommends that the mouse pointer be changed during 
the drag operation to reflect the action, while CUA requires that the copy and 
move pointers be used to reflect the drag operation, stating that it is essential to 
creating an interface that will be seen by users as being consistent with the CUA 
guidelines and its underlying principles. You, as users, designers, or program¬ 
mers need to decide for yourself and your products how important this area is for 
your product interface. 


How Users Interact with GUIs 


"Point, click, and pray. 

Peter Coffee, 1992 


A GUI should entice users to grab the mouse, trackball, or any other pointing 
device and jump right in to interact with everything they see on the screen. GUI 
interaction techniques involve both keyboard and pointing devices to navigate, 
select, and directly manipulate information in the interface. As I've discussed, 
GUIs typically combine the three basic interface styles (command-line, menus, 
and direct manipulation) on the screen. A well-designed interface should allow 
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users to choose the appropriate interface style depending on the tasks they are 
performing and their own personal interaction style preferences. The difficult 
part is providing a consistent, intuitive interaction style so users don't feel like 
they have to (as Peter Coffee comments) "point, click, and pray!" 


To Keyboard or To Mouse, That Is the GUI Question 

As I'm writing this chapter, I am using the keyboard almost exclusively, since I'm 
obviously typing lots of words. Any actions I want to do, including copying and 
moving text, I should be able to do without taking my hands off the keyboard. 
Yes, it may be easier and quicker to select some text and copy or move it else¬ 
where in this chapter using the mouse, but while I am doing lots of typing on the 
keyboard, I may want to do these actions without reaching for the mouse. A 
well-designed product user interface should let me do all of the actions on the 
keyboard that I could do using the mouse. 

However, I do find that I do some actions, like copying and moving text, us¬ 
ing the mouse even when I'm mostly working on the keyboard. That's my choice, 
which it should be, as to whether I want to use the keyboard or the mouse at any 
particular time. 

I remember many frustrating GUI products that forced users to go to the 
keyboard to perform certain actions when they were doing everything else using 
the mouse. Lately, I've also seen the interaction pendulum swing the other way to 
the point where GUI products get so wrapped up in direct manipulation tech¬ 
niques that users aren't allowed to perform some of the actions using the key¬ 
board. Sometimes the keyboard technique is so convoluted that there's no way 
users can remember the keystrokes. 

Just make sure your designers and programmers don't forget the product's 
keyboard users. Make sure that the interface is still keyboard-usable! Don't for¬ 
get that menu bars and most other menus must have mnemonics and shortcut 
keys to allow fast keyboard interaction. Also, remember that using either the 
mouse or the keyboard, users should only be able to choose currently available 
menu choices. 

There must be a happy medium somewhere in between the keyboard vs. 
mouse extremes. Who determines where products should place their emphasis 
on interaction styles and techniques? Yes, the users of the product should de¬ 
termine how they would like to interact with products they use. Unfortunately 
for designers and developers, there isn't an "average" user out there, and different 
users will describe very different personal interaction style preferences. To make 
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it even more difficult, users change their own interaction styles to suit the differ¬ 
ent tasks they do. Designers and developers can't design just for different user 
types, they must design for the different tasks that users do at different times. 


Using a Mouse with a GUI 

Let's take a look at how users interact with GUIs using a mouse or other pointing 
device. When IBM and Microsoft were working together on the IBM CUA user 
interface guidelines, there was a big difference of opinion over mouse interaction 
techniques. Microsoft designed Windows to use only mouse button 1 (usually the 
left mouse button) most of the time. This means both selecting items and directly 
manipulating them are done with the same mouse button. This may be comfort¬ 
able for most Windows users, but they don’t realize that they lose the ability to do 
some extended selection techniques because only one button is used to both select 
and directly manipulate objects. 

Microsoft would not support the IBM mouse button model in the Windows 
product. In the Windows interface, mouse button 2 is only used to bring up 
context-specific menus. IBM was looking forward to the object-oriented world 
where selecting and directly manipulating objects are related, but separate, tech¬ 
niques. The IBM CUA architecture opted to clearly split these techniques. OS/2 
uses mouse button 1 for selection and mouse button 2 for direct manipulation. I'll 
discuss IBM's mouse interaction techniques in OS/2 in the next chapter. 


Mousing Through Menus 

It's important to study how the mouse is used to navigate through menus and to 
select choices. Most GUIs support two styles of mouse interaction with menus: 
press-drag-and-release and point-and-click. Again, personal preferences determine 
how users weave their way through an interface with a mouse. 

Press-and-drag means that users may start anywhere in a visible menu by 
pressing down the mouse button over a menu choice. If the mouse pointer is on 
an item in the menu bar, the pull-down menu appears. Still holding down the 
mouse button, users can move through all of the pull-down menus by dragging 
the mouse pointer across the items in the menu bar. Moving down a pull-down 
menu will highlight a choice and will even open a cascade menu if there are any. 
No choice is selected or action begun until the mouse button is released. This technique 
allows users to easily explore all of the menu bar groups and choices just by 
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moving the mouse pointer through the menus while holding down the mouse 
button. To select a menu choice, users simply release the mouse button when the 
mouse pointer is over the choice they want. If users don't want to make a selec¬ 
tion, all they have to do is move the mouse pointer out of the menu anywhere in 
the window and then release the mouse button. 

The other technique, point-and-click, allows users to make selections and 
then move the mouse quickly to another selection. Users don’t have to worry 
about moving the mouse while holding down the mouse button. They just point 
to a menu choice by moving the mouse pointer over the choice. Clicking the 
mouse means pressing and releasing the mouse button without moving the 
mouse. Clicking on a menu bar item displays a pull-down menu. The pull-down 
stays displayed until users point-and-click somewhere else in the menu bar to 
display another pull-down, until they point-and-click on a pull-down choice, or 
if they click anywhere else in the window. 


Mousing with Pop-Up Menus 

Pop-up menus, or context menus as they are also called, are a newer menu style 
that are now available in both GUI and OOUI interfaces. Pop-up menus are 
simpler and more task-related than the menus available through the menu bar. A 
mouse button 2 click on an item is the technique to display a pop-up menu in 
both the Windows and OS/2 interfaces. Pop-ups are displayed next to the item 
they describe. Applications should use pop-up menus to display frequently used 
actions and menu choices that are available for the item in its current state. Fig¬ 
ure 7-20 shows a pop-up menu for an application object. 

Pop-up menus are a more dynamic and context-sensitive subset of the whole 
range of choices that would be available in the menu bar. Users can learn about 
objects and items in the interface by exploring with mouse button 2 and seeing if 
they have a pop-up menu and noticing what choices are on the pop-ups. 

The only setback I have found is that users must first learn what pop-up 
menus are and what objects have them. Then they also need to remember to 
check for them when working with objects in the interface. Because they 
"pop-up" at users, they are hidden to begin with and there is no visual indication 
that they even exist in the interface. Both the Windows and CUA interface design 
guides spend considerable time discussing and offering guidelines for designing 
pop-up menus. If pop-up menus are well-designed and consistently imple¬ 
mented, they can easily enhance user productivity. 
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Figure 7-20. GUI Pop-Up Menus* 


The GUI Editing Model 

I can’t end this section on interacting with GUIs without discussing how users do 
editing tasks within the Windows environment. Windows uses what I call the 
clipboard model for editing and manipulating data within and between applica¬ 
tions. Cut, copy, and paste are the basic editing operations users can perform on 
their data. The clipboard is a common data buffer that holds only one piece of in¬ 
formation at a time . Data in the clipboard is available to other applications. This 
model should apply across all different types of data and across all applications. 
The clipboard even works to transfer data between DOS, Windows, and OS/2 
products running under OS/2. 

When users Cut a paragraph of text from a document within a word¬ 
processing application, it is deleted from the document and is placed in the clip- 
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board. The same thing should happen when users cut a graphic element out of a 
presentation they are developing within a graphics application. Copy places a 
duplicate of the selected information in the clipboard without removing the 
original. Paste copies the contents of the clipboard to the target location and the 
information still remains in the clipboard. Figure 7-21 shows the clipboard and its 
contents in the Windows environment. 

One nice feature of the clipboard is that users don't have to think about how 
to edit in each specific application they work with. A well-designed application 
should allow users to select an object and select Edit, then Cut, from the menu 
bar. They can then go to another application, select a target location and choose 
Edit, then Paste, from the menu bar. If implemented correctly, the clipboard 
model for editing objects reinforces numerous interface design principles I've 
discussed. The clipboard model provides consistent interaction techniques for 
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different types of data. Most importantly, it makes the user interface consistent 
within and across applications. 


KEY IDEA! 


It is important for users to understand the clipboard model 
when they do any editing tasks. The metaphor is very simple, but it is not neces¬ 
sarily a visual one. The clipboard does not need to be visible during use, but that 
can be dangerous for users. Even though the clipboard need not (or might not) be 
visible, users must remember whether or not they have data in the clipboard. 
Since it only holds one item, as soon as another object is cut or copied using the 
menu editing choices, the new object replaces whatever was in the clipboard au¬ 
tomatically. For this reason, a Clipboard Viewer application is provided in Win¬ 
dows to allow users to visually see and manipulate the contents of the clipboard. 
It is difficult for people to remember what they've got in the clipboard if they 
have no visual indication of the clipboard itself, or its contents. 


For example, I had to be very careful when writing this book. Each chapter 
was contained in a separate file. While writing. I'd want to cut and paste mate¬ 
rial from one place to another, both within chapters and between chapters. I'd cut 
a paragraph from one chapter, intending on pasting it somewhere else in that 
chapter or perhaps in another chapter. However, if I didn’t go and paste the in¬ 
formation somewhere else fairly quickly. I'd forget that I had cut out the material 
and placed it in the clipboard. I'd continue writing and sometime later cut or 
copy some other material and end up losing the information I had in the clip¬ 
board without even realizing it. This is not a good thing to do to users. 


K E Y IDEA! 


It would be nice for applications to provide some visual 
feedback to users that there is something in the clipboard. For example, an in¬ 
formation line message or an icon in an application window could be used to let 
users know that the clipboard contained some information. This thoughtful and 
simple design point would go a long way in reinforcing the principles of provid¬ 
ing feedback to users and reducing their memory load of having to remember 
whether on not there was information in the clipboard. 


The clipboard model is very important in most GUIs today because most of 
the user interaction with their data is still through the use of the keyboard and 
menus, which is what I would call indirect manipulation. As GUIs move toward 
more pervasive direct manipulation techniques for editing data, the clipboard 
model will become less important. With direct manipulation, there is no need for 
a temporary data storage buffer such as the clipboard. Users choose the action by 
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virtue of the type of manipulation they are performing. They work with their 
data more directly, instead of relying on an external storage and memory source 
such as the clipboard. 


Composite Documents in GUIs: OLE! 

One of the powerful attributes of graphical interfaces is the ability to present dif¬ 
ferent types of data to users and also allow them to interact with these multiple 
data types in a consistent fashion. A composite, or compound document is an 
object or document that contains other objects, usually of a different type. In an 
application-oriented GUI environment, a composite document is a powerful tool. 
The Windows design guide states (Microsoft, 1992), "The compound document 
provides the framework for housing different components and for invoking their 
respective applications.” 

The technologies behind the compound document interface are still in their 
infancy stages. Users are acutely aware that they are working with different types 
of data and are using different applications to do their tasks, even within one 
document, the compound document. Progress is being made to provide better 
interfaces for users in this area. As the Windows design guide also points out, "In 
an ideal implementation of compound documents, the user is unaware that dif¬ 
ferent source applications are being invoked. The process of browsing, selecting, 
and editing information is seamless; users can manipulate various types of in¬ 
formation within the body of a single document without the inconvenience of 
switching from one application to another. 

The evolution of object technology and user interfaces has lead to the devel¬ 
opment of an area called Object Linking and Embedding (OLE). This allows us¬ 
ers to create not just compound documents, but "living" documents. That is, ob¬ 
jects within a document can link or embed other information from the document 
or even another source. Linking provides the ability to keep the original informa¬ 
tion or object somewhere and to keep a representation of that information in the 
document. The link serves to get the original information when needed, for ex¬ 
ample, when the original information is changed or when the display is updated. 

Embedding involves inserting a new or existing object, or piece of informa¬ 
tion, into a document. All of the information contained in this object is now 
within the document container. This allows users to store all of the components 
of a compound document in one file, rather than having separate files for each of 
the different objects contained in the document. However, if these objects are 
copies of other objects, and those other objects are changed, no changes will be 
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made in the embedded object. There are no links to an original object if an object 
is embedded rather than linked. 


212 


KEY IDEA! 


OLE version 1.0 is being implemented by developers, but like 
the compound document, it too is in the infancy stages. Version 2.0 should be 
available sometime in 1993 and should provide a better programming environ¬ 
ment for products using OLE. However, as with GUI systems in general, there is 
a large amount of complex technology involved here. Making OLE concepts and 
metaphors understandable to users will be a difficult and ongoing challenge for 
designers and programmers. Users should not have to understand the complexi¬ 
ties of OLE to do their tasks while working with compound objects. For example, 
do OLE objects behave the same way as other objects behave for drop and drag? 
Let's hope so. Windows Magazine (Heller, 1993) discussed this issue regarding the 
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upcoming OLE 2.0 product, "The new drag-and-drop functions should prove 
convenient for users and programmers alike...From a user's perspective, that 
means properly written OLE 2.0 applications will automatically 'do the right 
thing' when you want to drag objects to, from and within them." 


GUIs for the World? 


"They look great , but does everyone really need a GUI?" 

John Gantz, 1990 


Let's take a brief look at both sides of the Windows bandwagon. You'll have to 
decide on which side your feelings about Windows and GUIs in general lie. I'll 
also show you where Windows is headed in its next incarnation. 


The GUI Nay-Sayers 

"Applications within today's desktop architectures use the desktop 
to generate the illusion of visual objects like windows and their 
contents, but underneath fail to support deeper levels of 
integration from which users would really benefit." 

Steve Cook, 1992 


As wonderful as the GUI environment seems to be, not everyone is as excited 
about GUIs as you might think. The main criticisms come from those concerned 
with the actual impact of computers and especially software user interfaces on the 
productivity of users. The plain truth is that GUIs are not yet user-friendly 
enough and haven't necessarily proven to be the productivity aids that have been 
promised over the past few years. They also require costly hardware and soft¬ 
ware to run them. In fact, it may be easier and quicker to do many tasks without 
a GUI, and in fact, without a computer at all! The purpose of this book is to pro¬ 
vide you with enough information so you can decide what interface is most ap¬ 
propriate for you or your users and their tasks. You may decide that the best in- 
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terface for a particular task is a piece of paper and a pencil! I still can't see how 
balancing my checkbook using a computer could make the task any less tedious. 

A number of surveys and studies have uncovered what has become known 
as the "Futz Factor," or "Fiddle Factor," that is associated with users and their 
computers, and is now becoming widespread, especially with the popularity of 
GUIs. INFORMATION WEEK (Stromoski, 1993) described a survey of 6,000 PC 
users that showed, on the average, users spent five hours a week playing around 
and tinkering with their computers. 

Interestingly, the study showed that, "Men are bigger PC futzers than 
women, wasting nearly 20% more time in the process." The estimated business 
costs of users playing around with their computers at work is interesting to cal¬ 
culate. The estimated 25 million PC users together spend an amazing 5 billion 
hours a year futzing with their computers. According to the study's calculations, 
the cost of this work time is around $100 billion, or 2% of the United States gross 
national product. I've heard Windows experts say that, in their estimation, the 
most often used Windows software product is Windows Solitaire. That's prob¬ 
ably quite true. So, stop playing cards on your computer and get back to work! 

I've heard office workers talk of the "ugly memo syndrome." This is what 
happens when computer users first get their hands on Windows and a graphical 
WYSIWYG word-processing program. For months, their memos are filled with as 
many fonts, styles, point sizes, and clip-art graphics as they can squeeze on one 
page. Fortunately, this behavior seems to die off after a few months and they 
settle down to a reasonably good-looking memo style using only a few different 
types of text and a graphic or two. 

This user behavior can be compared to the behavior of the college writing 
course students that I discussed in the Technoculture section in Chapter 2. IRS 
agents were given laptop computers to do their off-site examinations (Buckley, 
1993). They did their examinations faster, but using the laptops didn't increase 
the number of exams they did. They spent their extra time writing more estheti- 
cally pleasing reports. The Futz Factor strikes again! 


KEY IDEA! 


One of our very human traits is that if an object or tool sitting 
in front of us has the capability of doing something, we tend to believe that it is 
our solemn duty to try out that capability, regardless of whether we have the time 
to do it or any need to do it. Here's my philosophy on the subject of users and 
their computers: "If it's a tool, they'll use it. If it's a toy, they'll play with it. If it's 
a productivity aid, they'll complain about using it." My wife accuses me of fol¬ 
lowing this philosophy all the time! 
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Windows is making great inroads into the corporate user environment. 
However, many corporate managers aren't happy with the situation. Says Bruce 
Muckain, in an article called Windows: Calling It Awkward Would be Kind, "The 
large and increasing market share garnered by Microsoft's Windows is proof 
positive that P.T. Barnum knew what he was talking about when he said, 'There's 
a sucker born every minute.' An addendum to Barnum's statement might be 'and 
many of them purchase computers and software for large corporations.'" 


KEY IDEA! 


The problem is that many businesses and corporations are 
standardizing on one computer hardware and software platform for their entire 
business operation. They have to do this for a number of reasons, the major ones 
being cost, consistency, and interoperability. Just as I've discussed in this book, no 
one hardware platform, software environment, or especially one user interface 
can be the best and most productive computing environment for every single one 
of the users in these companies. Different products and different interfaces 
should be made available to different users with different tasks. Muckain (1993) 
also comments on this interface-user mismatch, "When is corporate computer 
management finally going to realize that forcing Windows on computer users is 
like making a secretary take dictation while holding a pencil with a pair of pliers 
and a notepad in a catcher's mitt?" 


One of the problems of GUIs in general and Windows in particular, is that 
the interface doesn't do as good a job as it could of hiding the complexity of the 
underlying system, or at least making it easier to work with the system. There is 
a tremendous after-market for add-on products for Windows, some of which I've 
already discussed. Every day I get mailings for new products that advertise just 
how much help Windows users really need. 

Following the tradition of the desktop daily calendar, complete with words 
of wisdom for readers, there's a product called "Windows Tip-A-Day." In addi¬ 
tion to a daily calendar, the product instantly gives you tips, secrets, and shortcuts 
for Windows. "Windows tips can help you get the best performance from your 
Windows software-and troubleshoot your system, too. You'll get more out of 
Windows faster without having to dig through manuals for information that 
probably isn't even there. Get Windows Tip-A-Day today!" The product even has 
two modes for users to get more information regarding the daily tip. These 
modes are "Tell me more" and "Show Me How." If these kinds of products really 
are successful, then we know that the Windows operating system and the user 
interface really do need help! 
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The Costs of Going GUI: "Point, Click and Pay" 

"Yikes! Setting up a GUI can cost 50 times its street price. 

Even so, IS managers swear the strategic boost is worth it." 

Michael Fitzgerald and Carol Hildebrand, 1993 

GUIs are a large investment for both individuals, business, and corporations. The 
investment is in hardware, software, training, and support. The people making 
these investments are hoping that people have the time and inclination to learn 
and use their computers. Point, Click and Pay is the title of an article by Michael 
Fitzgerald and Carol Hildebrand (1993) that discusses some of the facts behind 
the glitz of the mass migration to GUIs. 

Hardware costs include graphics displays, more powerful systems, more 
memory requirements, and more storage space. It is also important to remember 
that with the trend toward a client/server environment and personal computers 
running more sophisticated operating systems, there follows a requirement for 
more sophisticated technical support personnel. These people must be taught 
how to deal with the newer hardware and software environments and technolo¬ 
gies. There is a growing opportunity for general education and job-related train¬ 
ing for software developers, designers, and users. 

Training is required to help users migrate from DOS systems and main¬ 
frames to the new graphical operating systems. There are also training costs to 
educate users on particular GUI applications. Christine Comaford (1991) notes 
that according to Microsoft Corporation, "becoming accustomed to a graphical 
user interface (GUI) should require eight hours of training." However, Comaford 
points out that numerous studies have shown that a more accurate estimate is 
between 20-30 hours of training were required. Obviously, users aren't finding 
GUIs as easy-to-learn as software developers would like us to believe. These 
sentiments are found throughout the industry. Bond (1993) sums it up, "The bot¬ 
tom line is this: In spite of the rhetoric associated with the term 'ease of use,' more 
people need more training in more subjects than ever before." 

Going GUI also isn't as cheap as we had expected, either. Recent statistics 
show that the somewhat hidden costs associated with migrating to the new op¬ 
erating systems are greater than we thought. It is widely known that there is a 
steep learning curve associated with migrating users from DOS systems or main¬ 
frame systems to GUI systems, but it has been difficult to put a dollar figure to it. 
A study (Microcomputer Managers Association, 1993) has shown that all of the 
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required hardware, software, training, and support costs bring the average price 
of moving to a GUI to almost $4,000 per system! 

The price of a software product, even an operating system, is a very small 
piece of the puzzle. You must include the cost of hardware (displays, memory, 
storage, and devices such as mice), training, and support. The MMA survey 
showed that to migrate to an operating system such as Windows or OS/2 can cost 
almost 50 times the current retail price (about $100) for the software. 

On the positive side, most corporate Information System (IS) managers say 
their migration plans are strategic and will be followed, regardless of the costs. 
Even though the initial costs may be high, many agree that the long term benefits 
will be less training and higher productivity. The Pacific Gas & Electric company, 
reports Fitzgerald and Hildebrand, "believes GUIs make applications easier to use 
and thus decrease the need for training in the long run." Fitzgerald (1993) also 
comments on the impact of user interfaces that we're talking about here; "After 
the initial learning curve for an application, IS managers say users often benefit 
from the Common User Access (CUA) built in to GUI applications." 

Are you thinking about or just recently made the leap to GUIs? There are 
always trade-offs. You must weigh the advantages and disadvantages of GUIs for 
you and your organization to determine if it is worth the expense and effort. 
Here are some thoughts on the positive side of this discussion. 


The GUI Yay-Sayers 

"You can never be too rich, too thin, or have Windows run too fast." 


Michael Elgan, 1993 


Jim Seymour, a well-known PC journalist, wrote in 1989, "GUIs are here now. 
They deliver real value and show where personal computing is headed. We think 
you'll decide that this is going to be a graphical user interface world." This was 
said four years ago, even before Windows 3.0 was released. If Seymour thought it 
was a GUI world then, where are we now? 

Are GUIs just computer hardware and software technology pushing users to 
spend money to migrate to newer and more powerful systems? Is the move to 
GUIs a natural evolution, or is it an inevitable step users must someday take? Is 
the GUI-OOUI war just a huge conspiracy between Microsoft, IBM, and the rest 
of the computer software and hardware industry? Whatever your feelings are on 
the subject, take a look at some research results. 
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The CUI-GUI Studies 


There have been many studies that investigated the benefits of GUIs compared to 
their predecessors, CUIs, or character-based interfaces. One of the most well- 
known studies in this area is The Benefits of the Graphical User Interface (Temple, 
Barker & Sloane, Inc., 1990). 

A Wharton Report (1990) titled The Value of GUIs noted the tremendous 
speed with which American computer users and developers were jumping into 
the Windows environment. They reported, "US industry observers believe that 
the speed with which Windows is being adopted could well change the balance of 
power within the PC software publishing business." This turned out to be quite 
true. The Wharton Report also discussed a (then) new study that addressed how 
effective graphical user interfaces were, compared to character-based user inter¬ 
faces. This was the Temple, Barker & Sloane study, commissioned by Microsoft 
and Zenith in 1989, completed and published in 1990. 

The study involved both experienced and novice users of word-processing 
and spreadsheet products. Users results were analyzed for speed and accuracy 
and users rated their subjective experiences both during and after the study. The 
research results supported seven benefits of GUIs over CUIs. The benefits were: 

• GUI users worked faster. 

• GUI users worked better (completed more tasks). 

® GUI users have higher productivity. 

• GUI users expressed lower frustration. 

• GUI users perceived lower fatigue. 

® GUI users were better able to self-teach and explore applications. 

® GUI users were better able to learn more capabilities of applications. 

Although these results seem to be overwhelming in favor of 
GUIs over CUIs, don't take these results as a sign for you to leap into GUIs if you 
haven't already done so. Throughout the 1990s, many businesses have found it 
very difficult to find any increase in actual user productivity that could be even 
remotely attributed to GUIs. 

As I point out in this book, computer software and their interfaces must be 
judged by their support of real users doing real tasks. Otherwise, you are only 
making a generalization that, of course, GUIs are better than character-based in¬ 
terfaces such as command-lines or menu systems. As you'll see next, there are 
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many well-informed and skilled people in the computer industry who don't think 
that today's GUIs are the be-all and the end-all of user interfaces. 


Will GUIs Survive the Coming of OOUIs? 


"The 'desktop metaphor' has gained almost unanimous support as 
a way to organize the appearance ofinformation on high-resolution 
displays of PCs. But current implementations of this approach are 
just a thin veneer on top of conventional file-and-application 
based approaches to information processing." 

Steve Cook, 1992 


Jim Seymour (1991) concedes a place in the sun for Microsoft's Windows, for at 
least the next few years. He says, "The battle among competing GUIs is certainly 
not over. Nevertheless, Microsoft's Windows is guaranteed a place among the fi¬ 
nalists through the 1990s." Why does Windows automatically have a place in the 
GUI honor roll for the 1990s? The answer is simple: market share. There are over 
20 million copies of Windows in the hands of users. No one will ever know how 
many of those copies are actually in use, or how happy users really are with 
Windows, but that is still one heck of a lot of software out there. 

Windows will probably still remain as the GUI for the masses for many years 
to come as users continue to migrate from the DOS environment. Let's hope that 
user-oriented enhancements continue to improve Windows and other GUIs as the 
competition increases among GUIs. Furthermore, as you'll see in the next chapter, 
the advent of interfaces that go beyond simply graphical to object-oriented should 
further drive GUIs to become as user-friendly as they have led us to believe. 


Where in the World is Windows Headed? 

The Windows phenomenon has arrived. It’s here and it's real. What does the fu¬ 
ture hold? Is there life after Windows 3.1? Here's a brief look at what Microsoft 
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has in store for you. As it is commonly called in the computer press, Microsoft's 
strategy is one of "Windows Everywhere." 

There are multiple parallel tracks that Windows is taking in the future. One 
track is the wonderful world of Windows and DOS. A second track is Windows 
NT. NT stands for New Technology (or as competitors say-Nice Try). The third, 
and newest, target of Microsoft's invasion is alternative hardware platforms for 
Windows. Jesse Berst (1993a, 1993b) keeps track of the Windows directions in his 
"Windows Watcher" column. Here's the latest scoop. 

By far the most attention is focused on Windows NT. The first release of 
Windows NT was in mid-1993 and was labeled Version 3.1. Calling the first re¬ 
lease of a new product Version 3.1 has Microsoft watchers chuckling. NT's goal is 
to integrate PCs, workstations, and networks into a Windows environment. From 
our perspective regarding the user interface, there isn't anything in NT to look at 
yet. There are no changes to the Windows 3.1 interface in the first release of NT. An 
enhanced object interface and object file system will be a major part of the next 
release of NT, code-named Chicago. This is targeted for 1995. Windows NT is not 
an operating system for casual users. Bill Gates himself has been quoted as say¬ 
ing, "If you don't know why you want NT, you probably don't want NT." 

In the Windows world, Windows 4.0 will incorporate a new 32-bit version of 
DOS and will be the next version of a Windows product to contain changes to the 
user interface. Windows 4.0 is code-named Chicago and is due in 1994. This 
version of Windows will introduce some of the user interface enhancements of 
Cairo. Windows for Workgroups is another flavor of Windows/DOS for the 
local-area network (LAN) environment, providing network management and 
electronic mail services. Windows for Workgroups (WFW) came out in 1992 and 
is due for an upgrade to Version 3.1 sometime in 1993. It has the same user inter¬ 
face as Windows 3.1. 

Finally, Microsoft will be looking to move the Windows product and inter¬ 
face onto other hardware platforms, in both directions. Windows now only runs 
on PCs that use the Intel-based technology. Look for RISC-based versions of 
Windows NT after the initial PC releases. 

Also look for Windows to move downward into the area of home and mobile 
computing systems with their Modular Windows product. Personal Digital As¬ 
sistants (PDAs) are one direction computer technology is headed, and Microsoft 
obviously wants to be there with an operating system. The residential cable, sat¬ 
ellite, and telephone computerized market is also on the horizon, and Microsoft is 
working on television boxes that interface with cable and satellite systems. These 
new technology boxes will enable you to shop, watch pay-per-view, and organize 
your TV viewing, all from your couch! Microsoft already has a software 
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developer's kit (SDK) available for Modular Windows. I will discuss these new 
technologies and their effects on user interfaces in depth in the final chapter. 

Just what is this new user interface that is the core of the Windows NT Cairo 
project and the Windows Chicago project? It's still too early to really tell, but 
"Windows Watcher" Jesse Berst (1993a) says, "What's all of this going to look and 
feel like when you use it? Although some of Microsoft's people have been saying 
the new interface will be 'revolutionary' and will 'leapfrog other interfaces,' noth¬ 
ing I've seen so far suggests any startling changes." 

An early version of Chicago was reviewed in September 1993 (Sullivan and 
Seltzer, 1993). Their comments mirror earlier thoughts on the "newness" of the 
interface: "The new interface borrows heavily from many other interfaces- 
including IBM's OS/2 Workplace Shell, Apple Computer Inc.'s System 1, NeXT 
Inc.’s NextStep 3.0, Hewlett-Packard Co.'s NewWave, and even the Open Soft¬ 
ware Foundation's Motif." 

What will the user interface for personal and home computing devices look 
like? I don't think we know yet what types of interfaces will really work well in 
these environments. Modular Windows is basically a stripped-down version of 
Windows 3.1. The Multiple Document Interface (MDI) capability and overlap¬ 
ping windows are gone. So too is the Common Dialog Box Library, Object Link¬ 
ing and Embedding (OLE), Dynamic Data Exchange (DDE), TrueType fonts, 
menus, and even most window elements, such as sizing borders and 
minimize/maximize buttons. Other new or revised controls are designed for the 
lower resolutions of television screens, such as scrolling lists and an on-screen 
keyboard for entering text. 

Meanwhile, IBM won't be sitting still with OS/2 development and en¬ 
hancements to the user interface. The next chapter discusses OS/2's past, present, 
and future. 


Are We in a War, or Are These Just Minor Skirmishes? 


KEY IDEA! 


Some observers see the GUI war as only minor skirmishes in 
the trenches as we battle our way toward greater glory, user satisfaction, user- 
friendliness, and increased user productivity at the human-computer interface 
(HCI). GUIs are not the ultimate user interface, and later I'll point out the direc¬ 
tions that the industry is headed in. Too much of today's graphical user interfaces 
focus on the "G" of GUI, the graphical aspect of user interfaces. User interfaces of 
the future will concentrate much more on the "H" of the HCI, the human aspect of 
user interfaces. 


Microsoft Windows: 


A GUI for the Masses 
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The goodness of the GUI revolution is that interfaces on very different 
hardware platforms are beginning to look remarkably alike. In the past, users 
had to do a tremendous amount of relearning or new learning when they moved, 
for example, from the Apple Macintosh to Microsoft Windows. These days, once 
users learn the basics, or core skills, of GUIs that I described earlier, these con¬ 
cepts and techniques should transfer across the different hardware platforms. 
This allows users to have some confidence that their knowledge of one system 
interface will help them learn a new graphical interface much quicker than if they 
did not have that experience. 


KEY IDEA ! 


Many people still remember Bill Gates' famous keynote ad¬ 
dress at the 1990 Fall Comdex show, titled, "Information at your Fingertips" 
(IAYF), as a memorable event in PC history. Microsoft has attempted to bring this 
concept to life with its Windows products. Well, folks, they aren't there yet. Ri¬ 
chard Dalton (1993) says, "My real disagreement with Microsoft's IAYF, however, 
is that, at best, it's misleading. At worst, it's an exercise in glossy hubris that can't 
serve Microsoft well in the long run.” Dalton's main point, and one with which I 
heartily agree, is that while information at your fingertips is an admirable goal, 
unfortunately, we're only at the point, at most, of data at your fingertips. The 
computer technologies and interfaces today can dump tons of data on the com¬ 
puter screens of inquisitive users. However we're a long way from turning those 
mounds of data into intelligently filtered, organized, meaningful, and useful in¬ 
formation for users to deal with. 


Bill Buxton, a computer scientist and worldwide interface consultant fears 
the widespread adoption of GUIs may slow the development of more powerful 
user interfaces. He states (Grantham, 1991), "The differences among GUIs are 
trivial compared to the differences between GUIs and what I know we are ca¬ 
pable of doing in user interfaces." With that thought firmly in mind, let's take a 
look at what many people see as the next step in the user interface evolutionary 
ladder, the object-oriented user interface, or OOUI. 
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IBM’s OS/2: 

Is the OOUI Ready 
for Prime Time? 


"Object technology offers much deeper 
approaches to integrating information 
within the workplace, transcending 
traditional application boundaries and 
matching processing power more 
closely to users' tasks." 


Steve Cook, 1992 



"Both companies realized that, if two different advanced DOS systems 
were developed, the software market would be confused about which 
was the 'right' one. So it made sense for IBM and Microsoft to combine 
efforts, and to create a single industry-standard operating system 
that was endorsed by the two leading companies in the PC market." 


Harvey Deitel and Michael Kogan, 1992 


Ibm and Microsoft began their intertwined operating system development efforts 
over ten years ago with DOS. Originally designed as a stepping stone to OS/2, 
Microsoft's work on Windows grew exponentially to the point where Windows 
became the main focus of the company's PC operating system strategy, rather 
than OS/2. 

The road to OS/2 began in 1985, when IBM and Microsoft signed a joint de¬ 
velopment agreement to work on an operating system that would go beyond the 
capabilities of DOS. Under the agreement, both companies would jointly design, 
develop, and own the final product. Why did these two largest hardware (IBM) 
and software (Microsoft) companies decide to do this work together? Deitel and 
Kogan's (1992) comment beginning this section sums up the simple and obvious 
strategy that began this phase of the IBM-Microsoft relationship. 

KEPBBMIKMMI As it turns out, both companies have stuck by the initial 
strategy which was the basis of their joint development efforts. The problem lies 
in each company's definition of "a single industry-standard operating system." 
The original intent was for OS/2 to be the mutual goal for this strategy. However, 
as development of OS/2 progressed slowly, and the development (and popular¬ 
ity) of Microsoft's own Windows product progressed rapidly, Microsoft switched 
their interpretation of the strategy to replace OS/2 with Windows as the single 
industry-standard operating system. That is the strategy switch that brought the 
PC operating system evolution to the GUI-OOUI war. 

A number of books and articles chart IBM and Microsoft's rocky road to 
OS/2. An easy-to-read chart was developed by Jenny Sanders (1992), in an article 
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titled, "The Long Road to OS/2 2.0." Figure 8-1 shows the major milestones to 
date in OS/2's development. 

All of this repositioning between Microsoft and IBM has set the stage for the 
war between Windows and OS/2 at the user interface. The Windows 3.0 interface 
rode the GUI wave to success and popularity. OS/2 1.3, meanwhile, was a stable 
product with a graphical interface, yet it did not enjoy the same commercial suc¬ 
cess that Windows had received. 

IBM, however, was preparing to make a leap, both functionally and at the 
interface level, with the OS/2 2.0 product. As early as October 1990, press clip¬ 
pings were hinting at IBM's plans for an object-oriented user interface for OS/2 
2.0. An article in PC Week (Pallatto, 1990) was titled, "IBM To Jazz Up OS/2 PM 
With Task-Oriented Icons." Cliff Reeves of the IBM Common User Access Inter¬ 
face group in Cary, North Carolina was quoted as saying, "During 1991, we are 
going to move to a more object-oriented style of dealing with the operating sys¬ 
tem. CUA 3 is sort of a generic term that we have applied to the next generation 
of the user interface model." Reeves is now the manager of the IBM Object Tech¬ 
nology Products area in Austin, Texas. Although OS/2 2.0 did not arrive on 
schedule in 1991, its ultimate arrival in April 1992 heralded the first product to 
implement the CUA object-oriented user interface architecture. 

Just what really is an object-oriented user interface, or OOUI? How is it dif¬ 
ferent from the Windows-type GUI? After reading this chapter, your questions 
should be answered. The computer industry is beginning to get excited about 
object-oriented interfaces and object-oriented programming technology. OS/2 is 
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also catching on as a successful operating system, thus promoting interest in its 
unique object-oriented features. 

The OS/2 2.0 product and user interface were beta-tested prior to its release 
at over 30,000 sites by more than 300,000 users. This was believed to be the most 
comprehensive pre-release software test for any operating system or application 
in PC history. IBM celebrated the first anniversary of OS/2 2.0 earlier in 1993. 
The achievements of the OS/2 2.0 product were many: more than two milli on 
copies shipped, more than 1,200 32-bit OS/2-specific applications introduced, and 
twelve international awards from computer trade publications for categories such 
as outstanding product and technical excellence. This includes Datamation 
magazine's 1992 "Product of the Year" award. These achievements should also 
help promote the development of object-oriented systems by IBM, other software 
application developers, tools vendors, and customers. Information Week (April 
19, 1993) reported that the Social Security Administration signed a deal to pur¬ 
chase 70,000 copies of OS/2, one of the largest single purchases of an operating 
system ever. Already, in mid-1993, the next release, OS/2 2.1 was delivered, and 
there were even a few new enhancements to the user interface. Let's take a closer 
look at the OOUI that started this revolution. 


The Basics of an OOUI: Beyond GUIs to Objects 


"Object Interface or Objects In Your Face? 

Larry Constantine, 1993 


The basic components of an object-oriented user interface include all of the fea¬ 
tures of graphical user interfaces I described in Chapter 7 (Figure 7-3). That's why 
it is so difficult to tell the difference between a GUI and an OOUI without sitting 
down and actually using an interface. Much of the look and feel of GUIs and 
OOUIs may seem the same on the surface, but the main differences lie in the 
models underlying the interface. One of the key characteristics of OOUIs is that 
they strive to remove the main drawback to GUIs I discussed earlier; their 
application-orientation. 

Object-oriented user interfaces aren't just a different flavor of graphical in¬ 
terfaces. They really are a means of taking the graphical interface environment 
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Application-Oriented 

User Interfaces 

Obj ect-Orienfed 

User Interfaces 

• Application consists of an icon, 
primary window, and secondary 
windows 

• Product consists of a 
collection of cooperating 
objects and views of objects 

• Icons represent running 
applications 

• Icons represent objects that 
may be directly 
manipulated 

• Users must start application 
before working with objects 

• Users open objects into 
views on the desktop 

• Containment is mainly shown 
using text list boxes 

• Folders and Notebooks are 
visual containers 

• Provide users with function 
needed to perform a task 

• Provide users with supplies 
needed to perform a task 

• Focus on main task 

• Focus on inputs and outputs 
for objects and tasks 

• Related tasks supported 
by other applications 

• Related tasks supported 
by use of other objects 

• Rigid structure-by function 

• Flexible structure-by object 

• Users can get trapped in a task 

• Users should not get 
trapped in a task 

• Training is centered on the 
application 

• Training should focus on 
common paradigms, look 
and feel 

• Users must follow the 
application structure 

• Users may perform task in 
their own way or innovate 

• Many applications required- 
one per task 

• Few objects-more reuse 
of the same objects in 
many tasks 


Figure 8-2. Application-Oriented vs. Object-Oriented User Interfaces 
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puter screen. The goal of OOUIs are to go beyond that. John Tibbetts (1991) dis¬ 
cusses the difference, "GUIs are the state-of-the-practice interfaces. We see them 
everywhere we look, but in some senses they are just multiplexing traditional in¬ 
terfaces, not really presenting objects. In a GUI, a window is a viewer into an 
application. An icon is just a shrunken window; a double-click on an icon means 
to run the underlying application." 

Tibbetts goes on to describe OOUIs, "An OOUI, on the other hand, invites 
the user to explicitly recognize and manipulate the objects on the glass. In effect, 
it extends the world of objects all the way out to the user. An OOUI appears to be 
a simulation, not a representation, of reality. In an OOUI, an icon is an object. 
Windows are simply viewers into the object. A double-click tells the object to 
open itself. Note that there don't seem, to be identifiable applications in an OOUI; 
there is merely a constellation of objects that a user can consider and manipulate. 
In a very real sense, the user is the application." 



Figure 8-3. Club Med Graphical User Interface * 
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Figure 8-4. Club Med Object-Oriented User Interface* 


It is critical for designers, programmers, and users to understand the differ¬ 
ences between application-oriented GUIs and OOUIs. Figure 8-2 lists the main 
differences between the two interface styles. Some of these items were listed by 
Orfali and Harkey (1993) in their book, Client/Server Programming with OS/2 2.1. 

To highlight the differences between application-oriented user interfaces and 
object-oriented user interfaces, Orfali and Harkey developed the same product, a 
travel agency reservation system they call Club Med, as a GUI and as an OOUI. 
Sample objects and windows for the two interfaces are shown in Figures 8-3 and 
8-4. The programming and interface differences for the two versions are dis¬ 
cussed in detail in their book. 

Application developers are slowly applying the object-oriented principles 
I've discussed in this book and are moving away from the traditional 
application-oriented design. Lotus Development Corp. has enhanced Freelance 
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Graphics for OS/2 release 2.0 to better coordinate user interaction between 
Freelance and Lotus 1-2-3. In a review for PC Week, Sullivan (1993) notes, 
"Freelance 2.0 takes much better advantage of OS/2's Workplace Shell than the 
previous OS/2 version, allowing users to concentrate more on their work than on 
the interfaces between OS/2 2.0 and earlier OS/2 or Windows user interface 
conventions." I'll discuss the migration from application-oriented programs to 
the object- and task-oriented software environment a little later. 


Core User Skills Needed for OOUIs 


"Suddenly the user is dealing with objects he 
can touch and grab and manipulate." 

Jeff Moad, 1992 


The IBM object-oriented user interface, known as the OS/2 Workplace Shell, re¬ 
quires users to have the same basic understanding of the core set of GUI skills 
(described in Chapter 7), plus some understanding of object behaviors; which ob¬ 
jects to use and how to use them. The basic object-oriented interface concepts, 
metaphors, and techniques are discussed in great depth in Object-Oriented Inter¬ 
face Design: IBM Common User Access Guidelines (IBM, 1992). I'll cover the main 
highlights of the core set of OOUI concepts that go beyond what I covered for 
GUIs. Figure 8-5 shows what the OS/2 2.1 interface might look like on the com¬ 
puter screen of a typical user. 


How OOUIs Can Hide the System From Users 

One main focus of an OOUI such as the OS/2 Workplace Shell is to hide the un¬ 
derlying system organization from users so they can concentrate on doing their 
work. Users who want to put a particular object or data file in a certain physical 
location in the computer system can do that easily. ITowever, most users, most of 
the time, don't want to worry about the way the system organizes their informa¬ 
tion. Many operating systems don't allow users this luxury. 
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Figure 8-5. The CUA OS/2 Object-Oriented Interface* 


Figure 8-6 shows that even the underlying computer system is presented to 
users as objects that they can interact with in the same way they interact with any 
other objects on the computer screen. The Windows File Manager program is re¬ 
placed by the set of objects that make up users' systems. As you can see, there are 
objects representing the system, mouse, keyboard, system clock, print spooler, 
and all of the disk drives that are part of the computer. Rather than using the 
Windows Control Panel program to view or change system settings, users can 
work directly with the objects they would like to change, and can even work with 
multiple objects at the same time. 
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Figure 8-6. OS/2 System Objects* 


Users Must Understand Objects and Applications 

Since the OS/2 Workplace Shell is the first implementation of an OOUI for the 
evolving PC environment, users will still be working with applications at the 
same time as they are also working with objects in the interface. As I've discussed 
earlier, the major applications will migrate toward object-oriented interfaces, and 
users will begin to see their favorite applications evolve into integrated sets of 
sophisticated objects rather than a single large application. Meanwhile, users will 
be working with a combination of both application-oriented products and 
object-oriented products. Figure 8-7 shows the mix of objects and applications 
that users might work with on their desktop. Objects on the desktop include a 
clock, calendar, shredder, wastebasket, printers, and folders. Applications might 
include an editor and any other programs. 
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Figure 8-7. Mixed Objects and Applications* 


KEY IDEA! 


While this situation will be confusing for quite awhile, even¬ 
tually users will see the benefits of working directly with objects rather than 
through applications. Using GUIs and OOUIs side-by-side should allow users to 
make the best possible comparisons and allow them to personally evaluate 
application-oriented and object-oriented interfaces and interaction techniques. 
Users should then put pressure on developers and demand that developers mi¬ 
grate their products as quickly as possible to the object-oriented environment. 


Standard objects should be familiar to users in their environment. Special¬ 
ized objects have special meanings for different users. For example, there is a 
wastebasket object and a shredder object on the desktop in Figure 8-5. Without 
ever having used these computer objects, don't you already have a good idea how 
they work? That is, at least, how they should work, according to your experiences 
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with similar objects in the real world. This is the true test of an interface; does it 
match your expectations and experiences as a user? 


Users Must Understand Windows and Object Views 


In Windows and in most GUI applications, a window is simply a running appli¬ 
cation. Both GUIs and OOUIs allow users to move and size windows in similar 
ways. In the OS/2 Workplace Shell, however, it is not necessary to minimize 
windows into icons representing the application. If users don't want a window to 
take up space on the screen, they can choose either to minimize it to an icon or 
simply hide the window. A window list allows users to see what windows they 
have open and they can manipulate windows directly or from the window list. 

In the OS/2 object-oriented interface, objects present themselves and the in¬ 
formation they contain as views to users. A view is a representation of informa¬ 
tion about an object. A view might show what is contained in the object. It might 
be the object's properties, or settings. It might be what the object will look like 
when printed, as we already described as a WYSIWYG view. 


KEY IDEA! 


Views of objects are presented to users in windows. In the 
OS/2 environment, with multi-tasking capabilities, users can work with multiple 
views of the same object at the same time, either multiple different views or the 
same view. You'll see examples of multiple views in figures in this chapter. This 
is a very powerful feature of object-oriented interfaces. Figure 8-8 shows the 
Windows clock application and the OS/2 system clock open in multiple views 
within windows. I'll discuss views in more detail later. 


Note the titles in the title bar of each window. The Windows clock just 
shows the name of the application (Clock). The clock application also has a menu 
bar with only one choice (Settings). The OS/2 system clock shows the name of 
the object and the name of the view of the object presented in the window, for 
example. System Clock-Date/Time and System Clock-Settings. This is a quick 
way to tell the difference between application windows and object windows. 


Users Must Understand Graphical Controls 

OOUIs use similar graphical controls that are commonly found in most GUI 
products, such as radio buttons, push buttons, check boxes, and so on. As I dis- 
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Figure 8-8. OOUI Object Views and GUI Applications* 


cussed, even newer controls originally developed for the OS/2 2.0 environment 
have been packaged and made available for GUI developers. Users migrating 
from GUIs to OOUIs should have no trouble recognizing and using the graphical 
controls. Users migrating from character-based interfaces will have to learn how 
to use graphical controls in either environment. 

There are a few differences in controls in the OOUI environment. CUA and 
OS/2 have tried to give users the capability of making changes immediately, 
rather than users having to perform any explicit actions to commit their changes. 
For example, users may change the colors and fonts for objects immediately, 
rather than choosing a particular color or font and then selecting an Apply push 
button. Some interfaces may have special uses for certain controls, but they 
should behave in the same way that users are familiar with for the same controls. 
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Some controls have specific uses and characteristics in the user interface. 
The notebook is an all-purpose control used to present any organized set of in¬ 
formation to users. In the OS/2 interface, the notebook is used to present settings 
views of objects. Figure 8-8 shows the notebook control in the settings view for 
the system clock. 


Users Must Understand Drag and Drop 

OOUIs rely heavily on users being able to directly work with objects to perform 
even basic actions, rather than interacting with menus. More context-specific and 
product-specific actions and processes are also performed using direct manipula¬ 
tion. Most direct manipulation is done using the mouse. There are even OS/2 
applets (mini-applications) and games that are designed to help users learn to use 
the mouse. Solitaire, Cat and Mouse, and others are located in the Games folder. 

Users must understand that direct manipulation is pervasive 
in an OOUI. They must be aware of this because there is one drawback to direct 
manipulation-users can't see on the screen any indication of the possible actions 
they can perform directly with objects. Keyboard actions and choices are listed in 
menu bars and context menus, but currently there is no way to visually show 
what direct manipulation may be available to users. Therefore, it is very impor¬ 
tant for interface designers to build sets of objects so that it is as intuitive as pos¬ 
sible for users to figure out which objects interact with each other and how they 
perform those interactions. 

For example, in an object-oriented office productivity interface, users should 
be able to drag the icon representing a customer and drop it on a telephone object. 
This action should dial the customer's phone number or prompt users if there are 
multiple telephone numbers associated with that customer. The same action also 
applies to dropping the customer object on a FAX object. This action should 
transfer the FAX telephone number for the customer to the FAX object, and allow 
users to type or select the information to be FAXed to the customer. 

GUI users are already familiar with the use of a mouse, but DOS users and 
even GUI users from different hardware and interface environments use the 
mouse differently. Macintosh users use a mouse that has only one button. Most 
Windows users are familiar with the 2-button mouse, but most Windows inter¬ 
faces use the left mouse button for both selection and direct manipulation. I'll 
discuss use of the mouse in IBM's OOUI in the interaction section. 
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The Object-Action Sequence 

The pervasive user interaction style for OOUI interfaces is the object-action se¬ 
quence. I've already discussed this in some detail for GUIs in Chapter 7, but it is 
an even more important concept for object-oriented interfaces. Regardless of the 
action to be performed or how it is to be performed, either via the keyboard or the 
mouse, via menus or direct manipulation, the process sequence is the same. Us¬ 
ers first locate and select the object or objects they want to work with, again, using 
any navigation and interaction technique. Then an action is performed, using 
whatever technique users prefer. 


Object Menu Bars and Pop-up Menus 

As you probably know, most GUI windows have menu bars. Menu bars contain 
choices that display pull-down menus when selected. Pull-down menus contain 
actions and routing choices that relate to objects in the window or the object that 
is represented by the window itself. I discussed menu bars for GUIs in Chapter 7. 
The GUI application-oriented menu bar is nicknamed the FEVH menu bar, where 
FEVH is based on the first letters of the standard choices in the menu bar (File, 
Edit, View, and Help). Let's now take a look at menu bars in the object-oriented 
interface. 

When should or shouldn't a window have a menu bar? The 
CUA guidelines say, "Provide a menu bar when a window will provide more than 
six action choices or routing choices. Also provide a menu bar if you provide the 
functions available in the File, Selected, Edit, or View menus." That's why you 
don't see menu bars on many of the OS/2 standard object windows. They are 
very simple, general-purpose objects that have only a small set of possible ac¬ 
tions. Product-specific objects will most likely have many more possible actions 
and routings, and thus will require menu bars in their windows. 

The migration from GUIs to OOUIs has brought a change to the menu bar 
for object windows. IBM (1992) states, "The menu bar choices and contents de¬ 
fined in this version of the CUA guidelines provide an evolutionary step towards 
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an object-oriented menu scheme." The reason behind the change in the menu bar 
is the change from data files opened within applications to objects opened within 
other objects. Figure 8-9 shows the CUA object-oriented menu choices for win¬ 
dow menu bars. This new menu bar style is called WOSH, which stands for the 
four areas the menu bar addresses: the window itself, the object being viewed in 
the window. Objects selected within the view, and, of course. Help. 

Users manipulate the window itself by using the System menu. This con¬ 
tains choices that change the visual characteristics of the windows and other op¬ 
erating system-specific choices. This menu is the same for both application- 
oriented windows and object-oriented windows, and is very similar to the 
Control menu in the Windows GUI environment. 

The File menu bar choice and pull-down menu from the application- 
oriented window are changed to provide choices for the object represented by the 
window. The menu bar choice label is now the class name of the underlying ob- 
















ject. For example, if the object is a folder, an open window for that object will 
display the class name. Folder as the first menu bar choice. All choices in the 
pull-down menu act on the folder object itself, not any information or objects 
contained in the folder window. 

The second menu bar choice is labeled Selected, and is used for container 
and data objects where objects within the window can be selected and actions 
applied to them. All choices in the pull-down menu will be applied to whatever 
objects are selected in the window. Notice the similarity between the menu 
choices in the Class Name pull-down and the Selected pull-down menus. The 
Selected menu choices are the same for an object in a window as would be the 
Class Name pull-down menu choices if a window were opened on the object. 

The other menu bar choices and associated pull-down menus are much the 
same for object windows as they were for application windows. The Edit menu 
providing data manipulation actions on selected objects in the window. The 
View menu changes the type of view or aspects of the view (such as include or 
sort) within the window. Help is still a very important menu bar choice in the 
object-oriented world. 

Pop-up menus are context-sensitive menus that display actions and routings 
that are currently available for objects. Figure 8-9 shows a pop-up menu for an 
object. Choices in pop-up menus should be frequently-used choices for that ob¬ 
ject. Pop-up menus in OS/2 are organized into three groups of choices: views, 
data transfer, and convenience choices. These groupings are designed to help 
users remember what types of choices are available in pop-ups. 

lammPM The object-oriented changes to menu bars may be confusing 
to some users, at least when they first use an OOUI. However, as seen in usability 
testing and everyday use, users tend to use pop-up menus and direct manipula¬ 
tion more frequently in OOUIs than when they were more often forced to use 
menu bars in most GUI applications. Menu bars probably are a transitional in¬ 
terface element as products move from applications to objects in the interface. 
OOUI users are quick to learn that they can get a pop-up menu just by clicking 
mouse button two on any object on the screen. 


Users See Objects Instead of Applications 


Objects are anything that users need to work with to perform their tasks. They 
are things that can be manipulated as individual units, or they may be made up of 
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other objects that have some relationship to each other. Objects, rather than ap¬ 
plications, are the focus of users' work in an object-oriented interface. 

lil'B'ai’IViVH When do designers know they have designed or created an 
object that works for users? Follow this advice I received from an IBM interface 
designer: If you can't describe the function of an object in a single short sentence, 
then you don't have an object that will resonate with users, especially if the sen¬ 
tence is as long and convoluted as this one. If users can't tell you what all the 
important objects are the next time you talk to them, in a day or so, with no 
prompting, then you don't have a good set of objects. 

The CUA user interface defines several basic types of objects. These types 
make up the fundamental classes of all the system-provided objects in the OS/2 
Workplace Shell. They are also the basis for objects developed by others for 
product-specific user needs and for users to create their own objects. The three 
basic types of objects are: data objects, container objects, and device objects. Let's 
look at each of these in more detail. Then I'll discuss views for each of these ob¬ 
ject types. 

As you'll see, many objects may have characteristics of each class of object. 
This follows how objects work in the real world. For example, an in-basket holds 
things, so it has some features of a container. Its main purpose, however, is to 
perform some task, such as sending the objects it contains to some person or des¬ 
tination. This behavior classifies the in-basket as a device object. It is important 
for designers and programmers to understand the object classes and their behav¬ 
iors. Objects must be implemented so that users' expectations of the behaviors of 
objects will be met. That is, the object defines what views can display and modify it. 
Objects that have container behaviors should provide views consistent with other 
containers. Objects that are devices should provide views appropriate for that 
device and consistent with other devices. 


Data Objects 

Data objects provide information to users. They may be any type of information 
users may work with, such as text, tables, images, graphics, music, recorded 
speech, video, animation, or any combination of them. Because data objects are 
usually product-specific, the CUA interface does not define individual data ob¬ 
jects. This is a task for product designers. 
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Data objects may also be composite objects, in that they may contain other 
objects. Newsletters, memos, spreadsheets, and presentations are examples of 
composite data objects. In addition to providing behaviors common to data ob¬ 
jects, they may also provide behaviors of container objects, such as a list of their 
contents. Figure 8-10 shows some data objects. 


Container Objects 


Containers are powerful tools for users to organize their work tasks and objects 
on the interface. Containers may store and group any objects together, including 
other containers. Container objects allow users to present their contents in dif¬ 
ferent ways, to move and copy objects to and from containers, and to arrange or 


Figure 8-1 0. OOUI Data Objects 























sort their contents in a particular order. Typical containers include folders, port¬ 
folios, in-baskets and out-baskets for mail, and so on. In OS/2, even the entire 
screen, called the workplace, or desktop, is a container and has all of the properties 
associated with containers. OS/2 provides three basic types of containers for or¬ 
ganizing users' tasks. These container types are: the workplace, folders, and 
workareas. Figure 8-11 shows the different types of containers. 

The workplace is the highest level container users work with. It holds all of 
the objects in users' computer screens. In many environments, this is called the 
users' desktop. As a container, it has properties that users can modify in the same 
ways they work with other types of containers. 

Folders are general purpose containers for storing objects. Workareas are 
special types of folders that provide more task organization than just simple 
storage. These concepts were designed to follow the ways users work in the real 
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world. Users might store receipts and memos in a general folder, not expecting or 
needing to use them together to perform a task. 

Workareas allow users to group things that they might use during the course 
of doing their work tasks. For example, you might have two separate projects 
you are working on at the same time. Instead of having objects on the desktop for 
both projects, workareas allow you to group together the objects you might use 
for each project. One project might require a special printer, a calculator and a 
special spreadsheet object in another folder. The other project might include your 
business invoices, billing objects, tools, other folders, and a printer set up for your 
billing. The advantage of workareas is that you can open up your objects, folders, 
and tools for a project and then close them up simply by closing up the workarea 
associated with the project. When you open the workarea for a project the next 
time, the opened objects and folders will automatically open up just where you 
left them on the screen when you closed the workarea. 

Containers may correspond to directories and subdirectories on users' com¬ 
puter systems, but only if users want them to. Most users will create container ob¬ 
jects as storage places on the Workplace Shell, where the containers don’t require 
any knowledge of the physical location of the objects themselves. This is a pow¬ 
erful way of shielding the complexities of the underlying system organization and 
file maintenance from users. 


Device Objects 

Device objects often represent physical objects in the real world. In the office en¬ 
vironment, any of the physical objects users work with can be represented in the 
user interface as device objects. These may be objects that are not necessarily 
computer-related, such as telephones and FAX machines. Computer-related ob¬ 
jects include printers, electronic mail in-baskets and out-baskets, and all of the 
objects that make up the computer system. Figure 8-6 shows some of the OS/2 
system device objects. 

The primary purpose of device objects is to provide ways for users to com¬ 
municate and interact with objects associated with their computers. For example, 
users currently might follow these steps to send a FAX of a memo to a colleague. 
First, users would write the memo on the computer and print it on a printer at¬ 
tached to the computer. Then they would look up the FAX telephone number of 
the colleague, either on the computer, or in a regular phone directory or address 
book. They would finally go to the FAX machine and send the memo to the in¬ 
tended person. 


B M 1 s OS/2: 


Is the OOUI Ready for Prime Time? 


245 



In an object-oriented interface, users might instead create a new memo or a 
FAX object. After typing the information in the memo, users might drag the 
memo object to the FAX object on the desktop interface. If the FAX number was 
already contained in the memo, that is all that needs to be done. If a FAX phone 
number is needed, users are prompted by the FAX object. Users could either type 
in the FAX number or drag an object representing the colleague to the FAX object. 
The colleague's object might be part of an address book or phone book object that 
contains telephone and FAX phone numbers. The FAX object and the address 
book object would know what information is transferable between the two ob¬ 
jects. 

Device objects may also have characteristics of other types of objects. For 
example, a printer and a wastebasket contain objects. The printer has a print 
queue associated with it, and a wastebasket should also allow users to open up 
the object and see what objects are contained within. The type of object charac¬ 
teristics and behaviors for any particular object will determine what views are 
appropriate for that object. 


Views of Objects 

I already mentioned that users must understand windows and views of objects. 
Let's look at views in more detail. Views are simply ways of looking at an object's 
information. Different views present information about objects in different forms, 
the way we look at objects in the real world. 

CUA defines four basic types of views of objects: composed, contents, set¬ 
tings, and help. Views are presented to users in windows. What appears in the 
window and how users can interact with that information are determined, in part, 
by the type of view of the object. Users may interact with objects via direct ma¬ 
nipulation, but they may also interact with objects, and the objects they contain, 
using views displayed in windows. 

The power of views and objects lies in users' ability to open 
multiple views on the same object at the same time. For example, you can display 
the time and date in one view of the clock object at the same time you are chang¬ 
ing the clock's display characteristics in another window containing the clock's 
settings view. 

The views I’ll describe here are defined for the standard objects available in 
OS/2. Products should start with these basic views and build product-specific 
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Figure 8-12. Composed View of a Car Object, from IBM (1992) 


views for the objects developed for the product. You'll see examples of standard 
views and product-specific views in this section. 

Composed views present the information and objects contained in an object, 
showing their order and relationships to other components of the object. Com¬ 
posed views are typically associated with data objects. For example, each book 
chapter I wrote is a data object that I worked with as a composed view. The order 
of the text and graphics in each chapter is important and determines the meaning 
of the chapter. If I change the location of a paragraph, the meaning of the infor¬ 
mation also changes. I also created a master document object, containing all of 
the individual chapter objects. Of course, the order of chapters in the master 
document is important, so I also worked with a composed view of the master 
document. 
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Composed views are very specific to the products and tasks users work 
with. For example, a car is an object. An artist creating drawings of the car for a 
brochure would use or create front, side, back, and interior views of the car object. 
A car salesperson, however, might work with a general information, or sticker 
price list, composed view of the car, and also views of the options and packages 
available for a car. Figure 8-12 shows a composed view of a car object used by a 
salesperson. 

Contents views list the components of objects. Contents views are standard 
for container objects. The order of contents views is not necessarily important 
and does not change the meaning of the object itself when the contents are rear¬ 
ranged. Three standard layouts are provided for contents views in OS/2: icon, 
details, and tree. These contents views are shown in Figure 8-13. 
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Any object having container properties might have a contents view. OS/2 
printer objects have a contents view in addition to the settings view of the printer. 
Data objects may also have contents views, listing their components, but since the 
relationships between components of a data object are important, their order in a 
contents view does have some meaning. 

Settings views allow users to view and change information or properties of 
objects. All OS/2 settings views are presented using the notebook control. Figure 
8-8 shows the settings view for the OS/2 system clock object. Settings views 
should be provided for all types of objects. In application-oriented programs, 
options and settings are usually presented in multiple dialog windows. In an 
object-oriented interface, users should be able to change all aspects of objects in a 
settings view, including colors, fonts, names, and so forth. 

The settings view and the notebook control can be broadly applied to many 
types of objects. As I showed with Lotus Organizer, the notebook concept is cen¬ 
tral to the real-world metaphor built by the product designers. Any type of ad¬ 
dress book, phone book, or information container object might be represented in a 
type of settings view, where users can view, organize, and store information about 
people, appointments, dates, and important events. See the address book ex¬ 
ample in Figure 8-14. The same contents views are available for this specialized 
container as were provided for standard folders. However, object-specific infor¬ 
mation is now provided in various views, as appropriate. Note that the personal 
information about each entry in the address book is provided in a settings view. 


KEY IDEA! 


Here’s an important aspect of objects and their views. As 
parts of the same object, views are tightly interrelated. As users make changes to 
an object, these changes should be reflected immediately, or as quickly as pos¬ 
sible. Using multiple views allows users to see the immediate visible effects of 
any changes they make. For example, open the icon contents view of a folder, 
then open the settings view of the same folder. Any changes made in the settings 
view that affect the contents view are immediately made visible. 


The final type of view, and definitely not the least important, is the Help 
view. Information is presented in help views to assist users in working with ob¬ 
jects. From the designer's perspective, help is a view of the object. Figure 8-15 
shows an object with its help view. Users typically access help information from 
the help choices in the menu bar or from pop-up menus. Help may be provided 
at the object level, and also at the individual element level, for example, for an 
entry field. This is called contextual help, and can be accessed by pressing the FI 
key, if it is available. 
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Figure 8-1 4 . View of an Address Book Object 


KEY IDEA! 


Here's a bit of advice. Help should be given to users in 
whatever form they desire or require. Help is a view of an object, and it is made 
up of information, or data. This data may take any form, as I discussed regarding 
data objects. Traditionally, help is textual information. Much research, and the 
advantages of the multimedia technology available in computer systems have 
enabled designers to provide help in a multitude of forms, including text, graph¬ 
ics, audio, animation, and video. Don't assume that designers know what type of 
help users would like. The design of help information is just as important as the 
design of the information users see on the screen as icons and objects. Please 
don't forget this! 


The object types (data, container, and device) are technical terms and users 
should only see object names or class names, such as document, folder, and 
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Figure 8-1 5 . Help View of an Object* 


printer. Composed view is a technical term which should be given a user name, 
such as WYSIWYG view for a document. Contents views are presented to users as 
the name of the type of contents view (icon, tree, details, or product-specific lay¬ 
out). Settings view is both a technical term and a user term, and is displayed just 
as Settings. Object and view names are displayed most often in menus and 
window titles. Each open window has the object name and the view name in the 
title bar. For example, a folder container opened into a details contents view 
might have Project Edie-Details View in the window title bar. 

SMWXMMMMMM Now that I've discussed the different types of objects and 
views, the tough job has not even begun. The definition of a product's objects and 
views is perhaps the most difficult part of the user interface design process. Don't 
get bogged down by the definitions I've given you. The distinctions between dif- 
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ferent object and view types can be blurry, so don't be too concerned about the 
exact category you try to place objects and views into. These object and view 
types should not necessarily be surfaced to users in the interface anyway. Many 
of the terms I've used are technical terms (for programmers and designers), rather 
than user terms. The Object-Oriented Interface Design guide (IBM, 1992) discusses 
general terminology guidelines for interfaces and supporting documentation. All 
technical terms and user terms are listed and defined in an appendix. 

It is important that users see meaningful and usable names of objects and 
views for the objects they work with and the tasks they perform. That's where the 
design focus must be. Carefully design object and view names. Be sure to con¬ 
duct some usability testing with customers and users to make sure they are com¬ 
fortable with the product interface and documentation terminology. 


Examples of Objects and Views 

Let's look at a familiar object, a clock. In most GUIs, a clock is available as an 
application. The clock face is presented in the window client area as the informa¬ 
tion presented to users by the application. Users change aspects of the clock by 
using the Settings pull-down on the menu bar, as they would with any other 
application. Figure 8-8 shows both the GUI and OOUI versions of a clock. 

An OOUI clock is an object. Even in a GUI, the clock really represents an 
object- the system clock that keeps time for the computer. As users of clocks and 
watches, what is your main view of a clock? Yes, the clock face is your main view 
of the clock, showing the current time and perhaps the date. What else can you 
do with most clocks and watches? Yes, you should be able to set the time, date, 
alarms, and any other bells and whistles associated with that clock or watch. The 
settings view of the clock allows users to change any of the properties of the sys¬ 
tem clock. This includes whether the clock is displayed in the traditional analog 
style (clock face with hands) or in a digital format. Users may choose to present 
only the time, or have both the time and date displayed. 

Let's take a look at product-specific objects and views. Relish® is a product 
specifically designed for the OS/2 object-oriented Workplace Shell. It is a calen¬ 
dar and appointment scheduling program that is very object-oriented. The major 
objects people use when using calendars and appointment books have been cre¬ 
ated for users on the screen. This includes appointments, meetings, notations, 
phone calls, and to-do items. Users directly create and manipulate these objects 
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and place them accordingly in their appointment book. Figure 8-16 shows the 
program objects with a menu of the views available to users. 


Migrating From GUIs to OOUIs 


"OS/2 is even better than I'd expected. Windows 3.1 is much worse. 
The result will be a more rapid 'paradigm shift' from Windows 
toward OS/2 than I'd dared to expect." 

William Zachmann, 1992 
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In the GUI-OOUI war, you're seeing many products migrate from the 
application-oriented world to an object-oriented model, both in the Windows 
environment, and on OS/2. Rather than provide large self-contained applica¬ 
tions, developers are beginning to provide users with tightly-integrated sets of 
objects that work together to form a product or task environment, as I've dis¬ 
cussed earlier in this chapter. Steve Cook (1992) sums it up well in his section 
titled The Death of Applications, "The consequences of object technology on the way 
software is delivered to end users will be considerable. Applications as we cur¬ 
rently know them will no longer be built. Instead, software packages will be of 
two kinds, which I will call components and frameworks. Users will configure 
combinations of these two kinds of software to create a working environment. 
This environment will be tailored for a particular individual's tasks much more 
than is possible with today's monolithic applications." 

In the past, and also in most of the current key products, there is consider¬ 
able overlap of different functions among many applications, regardless of their 
specialized area. For example, word processors today have sophisticated ways of 
working with text. In addition, users also want some graphic capabilities while 
they are writing. Therefore, even though they are word-processing programs, 
they also include some simple drawing features. On the other hand, the design¬ 
ers of the major graphics programs understand that users also want to include 
text in their graphics, so they provide some text capabilities. Users end up paying 
for larger applications than they want or have room for on their systems. Conse¬ 
quently, they also end up with overlapping functions across applications. How 
many of the applications you use have some spell-checking, text, and graphic 
capabilities of their own? Doesn't it make sense to use a set of word-processing 
objects, a set of graphic objects, and one spell-checking tool? 

Lotus Development Corp. has migrated their cc:Mail product to work with 
OS/2's Workplace Shell. Rather than a single application, as in previous versions, 
cc:Mail now provides users with an environment where they can act on mail 
messages by dragging and dropping icons. For example, users can reply to a 
message by dragging it to an out-box icon. cc:Mail objects can be deleted by 
dragging them to the OS/2 shredder. Users can also drag objects from other 
OS/2 Workplace Shell products over to a message object to mail them to other 
users. 

Apple's user interface is well-known as a popular and user-friendly inter¬ 
face. Although the underlying structure is still mostly application-oriented, 
Apple is moving quickly in the object-oriented direction. Cohen and Norr (1993) 
reviewed a new Apple open-document strategy, "The Apple-developed technol¬ 
ogy, called Amber, is designed to bring about a gradual shift from the 
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application-centered approach that characterizes desktop computing toward a 
more document-centered approach." Documents created using this architecture 
will store and display any type of data and allow users to edit any data type di¬ 
rectly from within the document. This is the composite document approach I've 
been describing in the object-oriented interface environment. 

The Relish product I just mentioned is also a good example of the way 
products are evolving from applications to tightly interrelated sets of objects that 
can be used to perform product tasks. Not only are users given objects and views 
to work with, but these objects can be used for many purposes. For example, the 
Relish monthly calendar can be displayed on the screen even when the program 
is minimized or hidden, so that users can refer to the calendar while they do their 
work. Any day's schedule can be retrieved from Relish with a simple mouse click 
on any particular day in the calendar. 


KEY IDEA! 


Relish, Lotus Organizer, and another similar product, the Ar¬ 
cadia Workplace Companion, are examples of one of the blossoming areas of 
graphical and object-oriented software products known as Personal Information 
Managers, or PIMs. Most people already use some kind of paper-based calendar 
or organizer for work or personal use, thus they already have a strong mental 
model of the objects they work with, such as calendars, appointments, notes, and 
telephones. It is often easier to develop interfaces for software products when 
there are already strong user models and metaphors. Figure 8-17 shows some 
objects and views from the Arcadia Workplace Companion. 


As products migrate along this path, their progress will be keenly watched 
by both critics and users. For example, Claris Works 1.0 combines a word proces¬ 
sor, database, graphics program, spreadsheet, and charting package in one prod¬ 
uct. Users can create any kind of document within another document. However, 
even though all of these features are included in the product, a product review 
(Powell, 1993) claims in the title that "Useful Features are Poorly Integrated." The 
review continues, "Though the spell checker is fast and efficient, the misspelled 
word is not always visible in the original document. Editing features are rudi¬ 
mentary: You have to highlight text you want to delete, since Claris Works lacks a 
delete current word or delete to end of line command. It's also missing other fea¬ 
tures, such as a word count and the ability to list the last four open files in the File 
menu.” Wouldn't it be great to have only one dictionary and spell check object 
that you could use with any documents and objects created with any program? 

The goal is not only to integrate well between objects that are part of the 
product, but to integrate with other objects on the OS/2 desktop and objects from 
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Figure 8-1 7. Arcadia Workplace Companion Objects and Views 


other products. For example, DeScribe allows users to drag and drop a data ob¬ 
ject from anywhere on the desktop or within a folder directly onto the insert icon 
within the DeScribe window. This inserts the data object into the DeScribe 
document at the point of the cursor. Ultimately, programs must be able to share 
data from similar types of objects. Users should be able to drag a name and 
phone number from one address book program, for example. Relish, and drop it 
onto a similar program such as Arcadia's Workplace Companion. These products 
should be friendly enough for users to share data between them. 

Because there is an evolutionary step from the application-oriented world to 
the object-oriented interface environment, CUA interface architects and OS/2 de¬ 
signers were very concerned about how users would react to the OS/2 Workplace 
Shell. In 1991, surveys were sent out to IBM customers and vendors, asking their 
opinions on a number of interface design issues. These issues covered a number 
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of interface areas, including: pop-up menus, clipboard support, window and ob¬ 
ject menus, menu bars for system objects, folders, and workareas, progress indi¬ 
cators, and keyboard support. Customer and vendor user feedback was influen¬ 
tial in the final design decisions regarding the OS/2 user interface. The voices of 
users are being heard! 


OOUIs and the User's Model 


"Using a more object-oriented interface, a user would be able 
to concentrate on the business process itself rather than the 
applications or files needed to accomplish it." 

Jeff Moad, 1992 


An OOUI should provide an environment that contains things that are familiar to 
users. The OS/2 interface is designed to provide such an environment by pre¬ 
senting familiar work and office objects for users. They can focus directly on 
business tasks and processes rather than having to translate how applications and 
systems function can help them accomplish their tasks. 


OOUIs and Real-World Metaphors 
"Objects should work like they look and look like they work ." 

Steve Shipps 


Look at the figures in this chapter and you'll see some familiar objects on the 
desktop like a wastebasket and a shredder. First notice that the object labels be¬ 
low the object icons are regular names, not computer file names. OS/2 allows 
object names up to 256 characters in length, including spaces and upper case and 
lower case characters. Text labels may also flow across multiple lines. 

Users are no longer arbitrarily restricted to naming things on the computer 
interface using strange and cryptic titles based on the DOS naming conventions of 
a maximum of eight characters with a three character extension. This seemingly 
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Figure 8-1 8 . Real World Object Names 1 


simple feature is actually quite complicated under the covers, but it goes a long 
way in helping users maintain a model of their work as they use a computer. 
Users had to define terse names that somehow provided information about the 
contents or purpose of the file or object. Users had to build elaborately coded file 
names such as THEOLTR6.DOC. The ability to give objects text labels helps users 
maintain real world models. It also helps users remember what objects are, and 
long names can be used to provide valuable additional information (Figure 8-18). 


Real World Containers 

OS/2's containment paradigm goes a long way toward allowing users to organize 
their work on the computer in ways that fit their models. The OS/2 desktop, for 
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example, is designed to be the main working environment for users. Some people 
have lots of folders, workareas, and objects sitting on the desktop. This is usually 
called the messy desk metaphor. Others like to keep only a few folders on the 
desktop and have all their objects stored somewhere in those folders. There is no 
one right way for users to set up their desktop. My desks at home and at work 
definitely follow the "messy desk" metaphor, and on the computer, I follow the 
same .metaphor, since I like to have lots of objects and containers on my computer 
desktop. As they say, a messy desk is the sign of an organized mind! 


KEY IDEA! 


Container objects such as folders and workareas are prime 
examples of objects that product designers and programmers can enhance to 
build powerful product-specific containers. For example, a library folder could 
be created that allows users to check out objects contained in the folder. This ob¬ 
ject could maintain a record of who has checked out each object and the dates of 
when objects are checked out and returned. This library folder could also check 
user profiles to determine if users are allowed to check out certain objects and 
would then restrict users from accessing objects that they are not permitted to 
use. The enhancement of container objects for product-specific tasks is one of the 
most frequent and powerful objects that I've seen created for most of the 
object-oriented interface projects I've worked on. 


Figure 8-19 shows an enhanced folder that organizes groups of objects con¬ 
tained in them in a structured, easy-to-use style. This example shows how a new 
type of view of a container-the group view-presents information to users. The 
main groups in the folder are listed on the left side of the window. The right side 
of the split window shows the contents of the selected group. As with the other 
OS/2 containers types, users don't need to know anything about the computer 
system to manage their information. 


Real World Access To Objects 

Another key aspect of the OS/2 OOUI is the ability to have objects be represented 
in multiple places. In the real world, there are things we have access to, no matter 
where we are. For example, most people have a telephone answering machine at 
their office and possibly one at home. You can obviously get your phone mes¬ 
sages when you are at home or at work, but most phone answering systems also 
allow you to play back your messages remotely from a telephone at any loca¬ 
tion. 
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Figure 8-1 9. Enhanced OS/2 Folder* 


This real-world concept is carried onto the computer interface by the ability to 
create shadows of any object in the interface. 

A shadow of an object is an icon that looks and acts just like the original ob¬ 
ject, but is actually just a reflection of the original object. For example, look at the 
interface in Figure 8-20. Users may want to have the same printer and a few 
charts and documents in both project workareas they are working with. There is 
no need to make copies of these objects to have them in multiple places. In fact, 
making copies of objects can cause problems, since a copy is a new object and if 
changes are made to the original object, they will not be reflected in a copy. Any 
changes made to an object, be it the data that makes up the object or the settings 
for the object, are automatically reflected in all shadows of the object. 

Shadows are often used for objects that may not even be in the users local 
environment. Remote objects and resources may be available to users, even 
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though these objects may not physically be in users' own locations. In that case, 
users may work with a shadow of a printer or other device that is remote, yet still 
available to them. The concept of shadows seems to work well for users in this 
environment, as they already know that they are working with an object that is 
not really there, but represents an object somewhere else that they can still work 
with. Working with remote objects is the same as working with local objects that 
are also on the desktop. 

It may be difficult to see the visual distinction between the original object 
and the shadows of an object. Text labels for shadows are a lighter shade than the 
text for objects. This distinction is intentionally subtle, because in users' minds 
they really are working with the original object when they use a shadow object. 

When users open a shadow object, the same thing happens as if they opened 
the original object. A visual cue that a window is open on an object is displayed 
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Figure 8-20. Objects and Their Shadows* 
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on the object and each shadow. Changes made to an object are immediately re¬ 
flected in all shadows, and changes made to a shadow are immediately reflected 
in the object and any other shadows of the object. This means if the original ob¬ 
ject is deleted, all reflections of that object are also deleted. However, if users de¬ 
lete a shadow, other shadows and the original object are not necessarily deleted. 


Real World "Sticky Pads " 

Another real world metaphor that is extremely useful in an object-oriented user 
interface is the template. A template is the term for what you know as post-it notes 
or yellow "sticky-pads n that everyone uses at home and at the office. The concept 
is the same on the computer; just drag from a template object and drop it any¬ 
where, and a new object is created. The template is even a more powerful tool in 
the object-oriented interface. Any object of any type (data, container, or device) 
can be made into a template object simply by selecting the Template check box on 
the General section page in the settings view of the object. 

OS/2 provides a folder of templates for all of the system objects provided in 
the OS/2 Workplace Shell. Other products that provide templates may add their 
templates to the OS/2 templates folder. Users may create templates of any objects 
they work with and they may keep templates anywhere they like. Creating new 
system objects such as printers is as easy as dragging a printer icon from the 
printer template and then defining the appropriate printer driver and output port 
in the Create Printer dialog. Users can create as many different system or prod¬ 
uct objects as they desire and may store them on the desktop or in any containers. 

The power of templates is that the original object may contain any type of 
data, including time-dependent or variable data. For example, invoices, a stan¬ 
dard memo, and a form letter all may have variable data that create data in a new 
object created from a template. An invoice template might contain an invoice 
number and the time and date of creation. As users drag an invoice from the 
template invoice, a new invoice is created containing a new invoice number and 
the current time and date. Figure 8-21 shows system object templates in the 
template folder and a product-specific template with its newly created object. 

IBM also provides a Sticky Pad applet, which lets users write notes, tear 
them off, and stick them anywhere on the desktop. Users can even minimize 
them as numbered icons in any corner of a window or the desktop. Data con¬ 
tained in sticky pad notes may be text or graphics and can be accessed via the 
OS/2 clipboard. Figure 8-21 also shows some OS/2 Sticky Pad notes. 
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sMMimMifflMMm It is important to understand the difference between the 
shadow objects I just discussed and copies of objects or objects created from 
templates. Shadows are links to an original object, so there are no copies or newly 
created objects, just the original object. A copy of an object is just that; a new ob¬ 
ject that is an exact replica of an existing object. Once copied, the objects are not 
linked or related in any way. Changes to one object do not affect the other object. 
Any object may be copied, including templates. Copying a template is very dif¬ 
ferent from creating an object from the template. A copy of a template is another 
template with exactly the same characteristics and data. The variable data is still 
variable data; the invoice number is still a variable, not a new invoice number. 
Using the real world sticky-pad analogy, a copy of a sticky pad is a new sticky 
pad with whatever writing or other information is associated with the sticky pad. 
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Figure 8-21 . Objects and Their Templates* 
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Creating from a template is like dragging off the top sheet of an electronic 
sticky pad. You don't get a template like you would if the template is copied. 
You get an instance of the object with all of the variable data, such as invoice 
numbers and dates, filled in for the new object. The OS/2 Workplace Shell offers 
users the templates in the template folder so they can quickly and easily create 
new containers and objects for their customizing of the desktop environments. 


Customizing OOUIs 


KEY IDEA! 


Speaking of customizing, OS/2 provides a wealth of oppor¬ 
tunities for users to customize almost any aspect of the interface, including the 
desktop and user objects, the behaviors of objects, and the interaction techniques 
users prefer. One of the key features of OOUI is that users can fully customize 
each object individually, in addition to personalizing the system as a whole. GUIs 
typically provide only system- or application-level settings and customization. 


OS/2 provides a host of special objects for users to customize their entire 
computer system. The computer itself is even presented as a set of objects, which 
users will find in the System Setup folder. This alleviates users having to go to a 
central control panel to do all of their customized system preferences. Figure 8-22 
shows some of the objects used for customizing different aspects of the computer 
system. These objects include the system display, keyboard, mouse, system clock, 
print spooler, sounds, and so on. 

As I discussed earlier, OS/2 provides a unique way to customize colors and 
fonts with the font, color, and color scheme palettes. The same way users work 
directly with objects, they can immediately change properties of an object by 
dragging and dropping a selected font, color, or color scheme on the object. 

Using these techniques, users can customize individual objects and win¬ 
dows, or apply changes system-wide. For example, users can change the back¬ 
ground color of each window individually to any color they like. They can also 
hold the Alt key while dragging a font or color to an object. This will change all 
the objects of that type in the same way. Designers and developers must be aware 
of users' tendencies toward the "ugly screen" syndrome. To help users get back to 
the basic setup for colors, fonts, and settings, always provide defaults, reset, and 
undo capabilities. Allow users to explore and create their own personalized in¬ 
terface, yet let them be able to return to the system configurations or defaults. 
This will encourage user exploration and customizing. 
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Figure 8-22. Color, Font, and Scheme Palettes* 


OOUIs and the Iceberg Chart 

As I discussed in Chapter 7, GUIs take a step in the user-friendly direction with 
graphical and visual representations of computer systems, applications, and data 
files. As you can see in this chapter, OOUIs go beyond the look and feel aspects 
of the iceberg chart and focus on building user models that carry over from the 
real world to the computer environment. The goals of a more object-oriented in¬ 
terface are to allow users to concentrate on their tasks and business processes 
rather than having to focus on how their computer system is set up or how to use 
the applications and files needed to accomplish their goals. 
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OOUIs and Users' Memory 


One of the primary goals of OOUIs, like GUIs, is to reinforce the design principles 
that reduce users' memory load. Similar to GUIs, OS/2 provides visual choices, 
lists of items, and graphic controls to allow users to recognize items and make se¬ 
lections rather than have to recall information and type information and com¬ 
mands. 

I've already discussed the memory benefits of all the types of menus, status 
bars, information areas, and the different types of help. I'd like to present some of 
the additional benefits OS/2 and OOUIs in general provide as memory aids. 

People have a difficult time remembering names. We don't remember 
peoples names who we were just introduced to, unless we really paid close atten¬ 
tion while they were being introduced. The same applies to the computer user 
interface. We are better at recognizing names for commands, applications, and 
objects than we are at trying to recall them. I already asked you how many of the 
DOS commands you could recall without any cues. I'm sure you can't remember 
all one hundred or so commands. 

OS/2 provides users with a powerful memory aid by allowing names of ob¬ 
jects in the interface to be up to 254 characters in length, and the names may flow 
across multiple lines. Users are no longer restricted to the traditional DOS eight 
character length names with an extension, such as THEOLETR.DOC. This flex¬ 
ible naming scheme helps users give objects familiar and memorable names, 
rather than coded and cryptic short names they can forget very soon after they 
developed the coding scheme. Any of the figures in this chapter show the use of 
long object names flowed across multiple lines. 

OS/2 window names also provide important information to users. GUI 
windows show the application name and data file name in the window title bar 
as memory aids. OS/2 shows the name of the object and the name of the view, 
such as Project Theo-Icon View. Since users can have objects open in multiple 
views at the same time, the information in the window title bar helps users re¬ 
member what object they are working with and what views they have opened. 

Icons represent objects in GUIs and OOUIs. They act as memory aids in 
addition to object names. Graphic design skills are usually required to develop 
icons that are useful memory aids rather than cute, but arbitrary visual symbols. 
Icons can be used as memory aids to provide information regarding object names, 
types, functions, or actions users may perform with the objects they represent. 
Often, usability testing is done early during interface design to let users evaluate 
sets of icons. Typical icon usability tests look at a number of attributes, including: 
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• Object meaning (which icon best represents an object) 

• Object identification (which icon in a group represents which object) 

• Icon effectiveness (to what degree does an icon accurately represent an 

object) 

• Icon groupings (which set of icons are more appealing to users) 

OS/2 containers, such as folders and workareas, also help users' memory. In 
Chapter 2, I discussed how people remember things better by organizing and 
grouping them into chunks. The OS/2 container objects organize and group ob¬ 
jects in ways that have meaning to users, especially since users organize the con¬ 
tainers on the desktop themselves. The workarea container not only allows users 
to group objects together, it provides task management by opening and closing all 
related objects within a workarea as the workarea is opened and closed. This 
task-oriented behavior controls related objects and windows rather than users 
having to do so. Users can also sort objects in containers by a number of criteria, 
such as name (alphabetical), type, size, creation date, or last access date. 

The use of contextual help, in addition to general help, provides a direct path 
to help information for the specific field or control users have selected. If no con¬ 
textual help is available, users must open up a general help window and either 
look through the topic index or do a keyword search to find help for the specific 
item they are working with. This is very frustrating, as users may have found the 
help topic they are looking for at some previous time, but they can't remember how 
they got to that help topic! 

OS/2 templates are also very powerful memory aids. Users don't have to 
remember what variable information is contained in an object, such as dates, in¬ 
voice numbers, customer information, and so on. Users creating a new invoice by 
dragging from the invoice template will get a new invoice with an incremental 
invoice number generated automatically by the invoice template object. The use 
of templates relieves users of manually entering required information that can be 
automatically generated by the program or the computer. Templates will become 
more popular as designers and users realize the power and support they provide. 

In an object-oriented interface, users must know where the objects they work 
with are stored. Usually they can be found in a container where users put them 
originally. Shadows allow users to keep objects stored in a location and never 
have to actually remember where they are stored to use them. Any objects, such 
as printers and mailboxes, can be placed wherever they are needed by creating 
shadows of them and placing the shadows wherever users will need them for 
their tasks. The shadow objects can be used exactly the same way as the original 
objects, without any need to know where the original object is stored. 


IBM's OS/2: 


Is the OOUI Ready for Prime Time? 


267 



Menus as OOUI Memory Aids 


I've already discussed the nature and importance of the different types of menus 
in GUIs and OOUIs.' One of the most important aspects of menus is that users 
don't have to remember all of the possible actions or choices available for objects. 
Most objects in OS/2 have pop-up menus that immediately show users what are 
the most frequently-used actions for that object. To see all of possible actions for a 
particular object in a window, users can select the object and view the choices 
available in the menu bar pull-downs. 

The options in a window's menu bar also remind users of the interface 
paradigm they are working with. If the first menu bar choice is File and the first 
choices on its pull-down are New and Open, users are working with the 
application-oriented style. The object-oriented window menu bar has Class 
Name of the object as the first choice, and Open as first in the pull-down. 


Visual Feedback as OOUI Memory Aids 

OS/2’s Workplace Shell interface is designed to encourage both developers and 
users to directly manipulate objects rather than use indirect methods such as 
command-lines and menus. As I discussed earlier, it is not visually obvious what 
direct actions can be done with objects, so it is very important that users get 
feedback about selections they have made and feedback about actions they are 
trying to perform directly. This is done with visual emphasis techniques that have 
been carefully designed to provide immediate and dynamic feedback about the 
tasks being performed. Figure 8-23 shows the visual emphasis techniques in the 
OS/2 interface. Later I'll discuss how users perform the direct manipulation ac¬ 
tions that these emphasis techniques support. 

Selected-state emphasis indicates that a choice or object is selected. 
Selected-state emphasis is displayed by changing the foreground and background 
colors of the selected object's icon to those set in the operating environment. One 
or many objects may be selected, and all selected objects in all windows should be 
displayed simultaneously. That is, the scope of selection is within a window. 
This is a memory aid because users can keep a set of objects selected within one 
window and switch to the desktop or other windows and select objects there 
without disturbing the selections in any other windows. Users can then return to 
any window and the previously selected objects are still selected. Selected em¬ 
phasis is only displayed for the active window, but the selection state is saved for 
each area and is re-displayed whenever a window or area becomes active. 


268 


The GUI-OOUI War: Windows vs. OS/2 



In-use emphasis is a visual cue indicating that a view of an object is open. 
In-use emphasis is displayed as diagonal stripes behind each appearance of an 
object’s icon. With the use of shadows of objects, this provides additional feed¬ 
back. If an object, or any of its shadows, is opened, all of the icons representing 
that object, including all shadows, will show in-use emphasis. 

Unavailable-state emphasis is used in menus to indicate that a choice cannot 
be selected. This is done by dimming, or graying out, the choice that is unavail¬ 
able. This feedback aids users' memory, since it is a reminder of the possible 
choices and actions for selected objects. Users don't have to recall what actions 
can or can't be done with certain selections, all they have to do is look at the menu 
choices. All unavailable choices are dimmed and the system will beep if users try 
to select them. Here's two important things to remember about unavailable em¬ 
phasis. First, allow users to cursor to the choice so they can select help for that 



Figure 8-23. OS/2 Visual Emphasis Techniques* 


IBM's OS/2: Is the OOUI Ready for Prime Time? 


269 







choice, even though it may not be currently available. Secondly, if a choice is 
never available to users, do not display the choice rather than display it with 
unavailable-state emphasis. 


K E Y I D E A ! 


During direct-manipulation operations, there must be four 
types of feedback provided to users: source emphasis, target emphasis, a dragged 
image, and the mouse pointer. 


Source emphasis is a visual cue that indicates which object or objects are be¬ 
ing manipulated. OS/2 displays a dotted-line, rounded-corner rectangle around 
the source object's icon. Source emphasis is also shown for objects when users get 
a pop-up menu for the object or objects. Remember that the OS/2 desktop is an 
object (a container object, to be exact) and these visual cues are shown for the 
desktop when it is the source or target of direct-manipulation operations. 

Target emphasis is used to indicate when the hot spot of the mouse pointer is 
over an object that supports direct manipulation. The target object may be any 
object that supports direct manipulation. This includes icons, an open window of 
an object, or interface controls that accept or display information, such as an entry 
field. When a dragged object is over a receivable object, target emphasis is 
shown. An icon will have a solid-line rectangle around the object icon. If the re¬ 
ceiving object is an open window or the desktop, the visual cue is shown just in¬ 
side the window or around the edge of the OS/2 desktop. In cases where objects 
are in order in a window, users can insert the dragged object between items in the 
window. There should be a visual cue-a line between the items—to let users 
know that they can insert the object between items. 

OS/2 provides visual feedback during the direct-manipulation operation by 
attaching an image or outline of the object or group of objects to the pointer when 
the objects are dragged. OS/2 currently shows the icons of the first three objects 
being manipulated as an image stacked in a row behind the mouse pointer. If 
more than three objects are dragged, two more generic icons are stacked behind 
the first three icon images. Source emphasis will also be shown on each object, 
but during the drag operation the source objects may not be visible. This feed¬ 
back gives users immediate and constant feedback as to what objects are being 
dragged during the action. This emphasis technique also gives a cue as to the 
nature of the action being performed. The default action is move, so the dragged 
images are in their normal darkness. If the direct-manipulation operation is pre¬ 
defined as a copy (by pressing the Ctrl key when the objects are dragged), then 
the images are dimmed to show that users will be creating copies of the objects 
and they are not just moving the original objects. 
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Finally, the mouse pointer itself is used to provide feedback to users while 
they are performing actions. The mouse pointer changes over areas of the screen 
and over objects as the mouse is moved. The move pointer is a dark arrow used 
to indicate that the resulting action will be a move. The copy pointer is a dimmed 
arrow to show that the action will be a copy. A wait pointer (an hour glass) is 
displayed if users cannot currently interact with the object the pointer is over. 
The do-not pointer indicates that the target object is not a valid target for the 
direct-manipulation operation. An I-beam pointer indicates that the pointer is 
over an area where users can type or select text. 

Creating shadow objects also has a visual cue associated with it. When users 
create a shadow by direct manipulation (Ctrl+Shift+drag), a link is displayed 
from the original object to the mouse pointer as it is dragged. When they reach 
the target and release the mouse button, a shadow object is created. 

All of the visual emphasis techniques I've discussed here are closely interre¬ 
lated and can apply to any object or set of objects at the same time. The visual 
cues for these techniques have been carefully designed so they can appear with 
any other emphasis cues and still provide specific information. For example, an 
object may be opened into a window, selected, and then moved with the mouse. 
In this case, the object icon would have three types of visual emphasis cues; in- 
use, selected, and source emphasis. 


KEY ID E A ! 


All of these visual cues are defined for OS/2 standard objects 
and common actions such as move, copy, and create shadow. Product-specific 
objects and actions should have their own set of visual emphasis techniques to 
provide meaningful, memory-aiding feedback cues to users during direct- 
manipulation operations. Part of the intuitiveness of direct-manipulation inter¬ 
faces is that users always know what objects they are working with, what opera¬ 
tions they are performing on those objects, and what the valid target destinations 
are for their actions. 


The Semantics of OOUIs 


"An OOUI utilizes a GUI for its set of componentry but adds to it a 
significant semantic content on the meaning of objects and user gestures. 

John Tibbetts, 1991 
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There is a key difference in the semantics, or meanings in the interface, between 
many GUIs and OOUIs. In a graphical user interface, the icons on the screen of¬ 
ten only represent computer applications and computer data files. There are 
some relationships between these objects, and users can associate some meaning 
to these icons and the actions they perform on them. For example, dragging a 
data file icon to a program icon starts the program and brings in the data file. 
However, these are more system-level actions and meanings rather than 
product-level actions. 

In an object-oriented interface, the icons on the screen represent objects that 
have definite relationships with other objects on the desktop. If these objects are 
designed to fit users' tasks, then users can understand the relationships between 
objects. Then they can build conceptual models regarding the interface. They can 
utilize the power of working directly with objects by performing actions directly 
on them rather than working through applications. For example, dragging a cus¬ 
tomer object and a car object to a worksheet object on an automobile salesperson's 
computer desktop brings all of the relevant customer and car information to¬ 
gether for the salesperson to complete the worksheet and sell a car. 

In addition to the basic objects I've discussed, groups of objects and se¬ 
quences of objects and actions can be brought together as processes that users do 
as part of their tasks. For example, the Relish product is moving in this direction 
by allowing users to define programs to run as objects. These objects can be ma¬ 
nipulated just like appointments, meetings, phone calls, and other objects in the 
program. This allows users to chunk objects and programs together in meaning¬ 
ful ways to help them do their work in a more automated fashion. 


The OOUI Way: Drag and Drop 

As I discussed in the previous section on user's memory, direct manipulation al¬ 
lows users to easily perform common actions directly on their objects. There are 
six general types of actions that users can perform directly on objects: copy, cre¬ 
ate, move, connect, change, and discard. These types of actions should be under¬ 
stood by all users and should apply to all objects in the interface, not only 
system-defined objects. Designers must work carefully to ensure that these basic 
direct manipulation techniques are implemented for their objects consistently 
with the ways users work with system objects and objects from other programs. 

fEHWE^M The power of user's models and metaphors can be invoked 
with well-designed object-oriented interfaces. Building product-specific objects 
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and defining meaningful and intuitive direct-manipulation operations between 
product objects is a critical piece of the user interface design for the product. 
Operations such as data transfer, automated processes, and communications can 
be provided to users as simple drag and drop actions between objects. 

The basic building blocks of an object-oriented interface can be used to build 
very powerful and sophisticated task-oriented interfaces in any environment. 
The interfaces you see today on most computers are designed for users who work 
with information to make their business decisions. Members of this audience are 
called knowledge workers. As computers proliferate into other areas such as 
manufacturing, distribution, and other services, the interfaces should be different, 
because the users, their tasks, and their goals are all different. But object-oriented 
interfaces allow users to work with objects that are representative of the envi¬ 
ronment they work in, rather than objects the computer understands. 


How Users Interact with OOUIs 


"An important step in improving usability and functionality is 
enabling users to directly interact with every aspect of a product's 
user interface. Instead of sifting through a complex maze of 
commands and pull-down menus, object-oriented applications 
enable users to directly interact with and manipulate every element 
or ' object ' on the screen. This direct interaction empowers the user, 
dramatically enhances the usability of the application, and improves 
the user's productivity." 

Philippe Kahn, 1993 


As with GUIs, well-designed OOUIs provide users with multiple interaction 
techniques to complete their tasks. Users should be able to do all of their tasks 
from either the keyboard or by using a mouse, or by switching back and forth be¬ 
tween the keyboard and mouse. Both these interaction techniques can be used 
with menus. OS/2 provides both DOS and OS/2 command-line interfaces, either 
within a window or full-screen. The OS/2 command-line interface crosses system 
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boundaries, that is, users can type any DOS, Windows, or OS/2 command from 
the OS/2 command-line prompt. So users don't have to open up separate 
command-line windows, one OS/2 command prompt window will do it all. 

Users who know how to navigate within the computer system and who 
know the commands they would like to use may find the command-line interface 
quicker than menus or direct manipulation. Some users switch back and forth 
between the command-line window and the OS/2 desktop because they can do 
some tasks quicker using commands, or they may not yet have figured out how 
to do some tasks using the interface menus or by direct manipulation. 

I've already discussed how OS/2 uses visual feedback as memory aids for 
users. The purpose of visual feedback is to tell users where they are in their cur¬ 
rent interactions with the computer and what are the possible interactions they 
can do next from their current situation. Well-designed visual feedback provides 
valuable information to users about their interactions with the computer. 


To Keyboard or To Mouse, That Is the OOUI Question 


KEY IDEA! 


All OS/2 interface actions can be performed either by 
direct-manipulation operations with the mouse, if available, or by using menus 
with either the mouse or the keyboard. One of the key design goals of the IBM 
CUA interface architecture is to allow users to do all actions using either the 
mouse or the keyboard. This goal is important for users to control the ways they 
like to work with the computer. Also, many people may not use a mouse for 
personal preference or for physical reasons. 


From the keyboard, users can choose to work with the command-line inter¬ 
face for OS/2 or DOS, and possibly a product's command-line interface, if one is 
available. The keyboard can also be used to navigate GUI and OOUI menus, both 
the menu bar and the context-sensitive pop-up menus. Many common menu bar 
pull-down choices have predefined standard keyboard shortcut keys. These are 
fast-path keyboard techniques to select menu choices without having to navigate 
through menus to display the menu choice. The menus do not need to be dis¬ 
played to use shortcut keys. For example, the standard editing choices have pre¬ 
defined shortcut keys, as follows: Cut (Shift+Delete), Copy (Ctrl+Insert), and 
Paste (Shift+Insert). 

Special operations in OS/2 may be done using either the keyboard or the 
mouse. These operations include directly editing the title text of an object, dis¬ 
playing pop-up menus, and displaying the OS/2 window list. Direct editing an 
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object title can be done either on the object's icon text label or the title bar of an 
open window for that object. The OS/2 window list shows all of the opened 
windows on the desktop, whether they are opened, hidden, or minimized. These 
operations can be customized in the settings view for the keyboard and the 
mouse objects for users to choose whatever keyboard or mouse button mappings 
they like to use on their computer. Users can even move quickly around the OS/2 
desktop using the keyboard. The cursor keys will move the selection cursor from 
object to object and users can also type the first letter of an object to move the 
cursor directly to that object. If there are multiple objects with that first letter, 
pressing the key multiple times will move the user to each object whose title be¬ 
gins with that letter. 

The mouse is used for directly manipulating objects, that is, if the operating 
system, the products, and the objects themselves support direct manipulation. 
Let's hope they do! The mouse is also heavily used to access all types of menus, 
including the menu bar, pull-downs, tool bars, palettes, and pop-up menus. 


The OOUI Mouse: A Powerful Weapon 

In Chapter 7, I discussed the differences that grew between IBM and Microsoft 
over the use of mouse buttons for selection and direct manipulation. Microsoft's 
Windows environment uses mouse button 1 for both object selection and direct 
manipulation. IBM's CUA interface architecture and the OS/2 Workplace Shell 
chose a different strategy-to separate selection from direct manipulation. Mouse 
button 1 is for selection while mouse button 2 is used for direct manipulation. 
This allows users a wider range of interaction techniques for both selection and 
direct manipulation that are complementary and don't overload one button on 
the mouse. 

The selection and direct-manipulation operations can be customized in the 
settings view of the mouse object so users can customize the mouse button map¬ 
pings they like to use on their computer. Users familiar with the Windows mouse 
mappings can configure their OS/2 mouse to work the same way, with mouse 
button 1 used for both selection and direct manipulation. However, they lose the 
ability to do some of the more powerful selection techniques. Figure 8-24 shows 
the mouse button mappings in the Settings notebook for the mouse object. 

The process of selection allows users to indicate which items they want to 
work with. Selection can be accomplished by using a pointing device, such as a 
mouse, or the keyboard. The selection process is designed to model how users 
work with objects in the real world. To work directly with objects, they don't 
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need to be selected. By doing something directly with an object, it is implicitly se¬ 
lected. In the real world, you don't necessarily have to select something before 
you work with it. This means users don't have to select an object to drag it, and 
by dragging an object, users don't disturb the selected items in the same area as 
the dragged object. To work with a group of objects, they must be explicitly se¬ 
lected before an action can be applied to the entire group. 

The scope of selection is the area within which users select items. This is de¬ 
fined at a number of levels: within a control, a group of controls, a window, and 
the desktop. For example, users choosing items from a list box are within the 
scope of that one control. Each open window has a scope of its own, that is, users 
may select objects in one window and that selection will not disturb selections in 
any other windows. This also applies to the desktop, where selections on the 
workplace don't affect selections made in any open windows. 



Keyboard Selective Install Mouse Device Driver Install Power 


Migrate Applications 


Spooler 


-Dragging object 
O Button 1 
© Button 2 


-Disp] ay in g Wi n d. o w;Li st ■ 
Q Button-2 - 
® Buttons 1 and 2 


Printers 


Mappings 


-Displaying pop-up menus—--——- 
□ Button 1 ® Single-click ...□ Ctrl 
E2 Button 2 -Q Double-click □ Shi! 


General 


Templates 


“Editingtitler* * / yt 

H Button 1 © Single-click ’QCtrl 
□ Button 2 : 0 Double-click pShift 


Games 


Waste 

Basket 


Default 


Shredder 


Figure 8-24. Button Mappings in the Mouse Settings View* 


276 


The GUI-OOU 


War: 


Windows vs. OS/2 









There are three types of selection: single, multiple, and extended selection. 
They are differentiated by the selection results. Single selection allows users to 
select only one item at a time in the scope of selection. Multiple selection allows 
users to select one or more items at a time within a given scope. Extended selec¬ 
tion allows users to select one item and then extend the selection to other items in 
the same scope of selection. All of these selections can be made with either the 
keyboard or with the mouse, using a number of techniques. These techniques are: 
point selection, random-point selection, and point-to-endpoint selection. 

Who decides which type of selection is appropriate for a given control or ob¬ 
ject? Designers decide which type to implement, but their judgements should be 
based on the type of selection users want in that situation. Don't restrict users to 
single selection when they really want to do multiple selection. On the other 
hand, if there is only one valid choice allowed at one time in a certain situation. 



Figure 8 - 25 . Design Considerations for Selection, from IBM (1992) 
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don't allow users to do either extended or multiple selection. Designers must also 
decide what the minimum number of selected choices is. If no choice is required, 
it is called zero-based selection. If at least one choice must always be selected, it is 
called one-based selection. Again, who should determine the minimum number of 
selections allowed? Users should determine it, designers should design it and al¬ 
low users to do it easily. The various combinations of selection types and tech¬ 
niques make selection decisions very important in interface design. Figure 8-25 
shows the design considerations to be made regarding selection. 


OOUI Drag and Drop Techniques 

Direct manipulation is a way for users to work directly with objects using a 
pointing device such as a mouse. There are usually a small set of actions that can 
be directly applied to many objects. These actions apply to both system-level and 
product-specific objects. They may be common actions such as move, copy, print, 
and delete. Direct manipulation is also called drag and drop, since users can pick 
up and drag objects and drop them on other objects. This implies that there is a 
source object(s) and a target object for direct-manipulation operations. 

There are predefined default results for the drag and drop actions. These 
defaults are determined by the types of objects involved as the source and target 
of the drag and drop operation. CUA (IBM, 1992) specifies the following prin¬ 
ciples for direct-manipulation operations: 

• When possible, the result of dragging and dropping an object should be 
the result that users would expect, given the source object and target 
object being manipulated. 

• The result of direct manipulation should be comparatively "safe"-that 
is, users should not lose information unexpectedly. 

® Users should be able to override a default result to obtain a different 
result. 

Initially, users are afraid that once they begin a drag and drop action, they 
can't change their mind while they are dragging objects around the desktop. Us¬ 
ers sometimes don't want to let go of the mouse button for fear they will do some 
action they don't want. Don't worry! Users can just press the Esc key on the 
keyboard and the current direct-manipulation action will be cancelled. 

The combination of selection and direct manipulation techniques allows us¬ 
ers to work directly with objects in many ways to perform whatever operations 
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they’d like to do at the moment. For example, to create shadows of a set of ob¬ 
jects, simply select the objects in one of a number of ways and then perform the 
create shadow direct-manipulation action with the mouse to create the shadows 
at the target destination. 


Interacting with Objects and Views 

I've already discussed the importance of views of objects in this chapter. Views 
allow users to work with multiple instances of objects at the same time. For ex¬ 
ample, users may wish to work with both the outline view and composed view of 
a document at the same time. Views also allow users to work differently with ob¬ 
jects depending on their tasks. To restructure a document, users need only the 
outline view and don't have to use the composed view of the document. 

Views allow users instant access to an object and its views. From an object, 
users can open any views of that object. From a view of an object, users can also 
open any views of the object. The same view may also be opened in multiple 
windows. All views of an object are dynamically interrelated. For example, users 
may wish to open two composed views of a document in separate windows to 
work on different sections. The program and operating system must make sure 
that any changes to a view that affect other open views are displayed immedi¬ 
ately wherever they apply. For example, changing the page format of a document 
in one composed view should also change the page format of the same document 
opened in another composed view. Changes in a view that are local, such as re¬ 
arranging objects in an icon view of a container, don't affect other views of the 
same object. 


The OOUI Editing Model 


Users edit objects in OS/2 either by indirect- or direct-manipulation. Indirect 
manipulation techniques use the clipboard model via menus in similar ways as 
Windows applications. The clipboard is an OS/2 system object that holds entire 
objects or parts of objects, and it can hold any type of object. As in Windows, us¬ 
ers can copy, create, and move objects to and from the clipboard. Figure 8-26 
shows the OS/2 Clipboard Viewer. 


KEY IDEA! 


An advantage of OS/2 is the ability to use the clipboard 
across DOS, Windows, and OS/2 programs. Actually, users can choose to either 
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Figure 8 - 26 . OS/2 Clipboard Viewer* 


make individual "private" clipboards for each session they are working in, or to 
share data across environments and programs by making the clipboard "public." 
That is, users can cut-and-paste data and objects to and from the OS/2 clipboard 
from any program, regardless of which environment the information was created 
in. This is a valuable tool in today's mixed application and data environment. It 
relieves users from having to remember the application and environment aspects 
of their work so they can concentrate on their tasks and the data itself, rather than 
the computer system. 

The object-oriented nature of OS/2 and the sophisticated direct- 
manipulation techniques available to users allow them to do most of their editing 
directly, rather than through the clipboard. The clipboard model will still be used 
by users migrating from a Windows GUI environment, by keyboard users, and by 
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users editing information across DOS, Windows, and OS/2. I've already dis¬ 
cussed the OS/2 direct-manipulation techniques for copying, creating, moving, 
discarding, and making shadows. Following the design principle of letting users 
be in control, OS/2 lets users edit information and objects using any combination 
of indirect- and direct-manipulation techniques. 


The Graphic Design of OOUIs 


KEY IDEA! 


OS/2 1.3 and Windows users will notice significant im¬ 
provements in the visual appearance of the OS/2 2.0 and 2.1 user interface. The 
primary goal of the visual design of OS/2 Workplace Shell was to highlight the 
user and task capabilities of the object-oriented interface. As I pointed out earlier, 
visual information such as color, shape, and size should be used to focus attention 
on information users are working with, rather than to spice up the user interface. 


I discussed the perceptual and psychological factors associated with colors 
and visual information in Chapter 2. Design guidelines for the use of color in the 
interface are presented in Chapter 4. All of these areas were addressed in the vi¬ 
sual design of OS/2 2.0. Notice the subtle colors and less-emphasized window 
borders. These aesthetic features let users concentrate on the information pre¬ 
sented to them on the screen rather than the background and other extraneous 
elements that are a necessary part of a graphical user interface. OS/2's visual de¬ 
sign was developed to follow IBM's Corporate Interface Design guidelines, In¬ 
ternational Standards Organization (ISO) guidelines, and to converge with the 
Open Software Foundation (OSF) interface visuals. 

OS/2 2.0's mouse pointer visuals were made smaller and were colored solid 
black to maintain visual contact for users while keeping the pointer unobtrusive. 
OS/2 controls, such as scroll bars, radio buttons, check boxes, and window sizing 
buttons were redesigned to use a three-dimensional effect only where they would 
provide additional information for users, for example, to show that an item 
would have an immediate effect when selected. 

Message symbols were redesigned to use international symbols for informa¬ 
tion, caution, and do-not. The symbols are also smaller and use a color scheme to 
help distinguish message types. The OS/2 default color scheme and color scheme 
palettes were designed to follow the subtle, sophisticated visual design approach 
for the interface. 
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KEY I D E A ! 


Icons are a critical component of all GUIs and OOUIs. As you 
know, icons are used to represent applications and objects in the interface. Icons 
are even more important for OOUIs, since there are many types of objects to 
identify, rather than just applications, data, directories, drives, and so on. The vi¬ 
sual aspects of icons should provide meaning to users regarding what objects are 
and what users can do with them and to them. 


IBM has published an Icon Reference book (IBM, 1991). It is available 
through IBM branch offices as are all other IBM publications. The purpose of this 
book is to provide graphical interface designers and programmers with a set of 
standard icons for common objects for a number of computer environment 
metaphors. This allows designers to use icons in a consistent manner for objects 
that users may work with across products and environments. This is the only 
icon design reference book of its kind in the industry. As a result of this work, 
IBM is working closely with the ISO standards groups on icon standards. 


Tweaking the Interface: OS/2 2.1 Enhancements 


OS/2 2.0 was the first release of the Workplace Shell user interface. Although it 
was based on years of interface research, prototyping, and user testing, there are 
always things that can be improved after the first release of any software product. 
One measure of the success of the original design of the Workplace Shell interface 
is how few improvements were actually needed in the interface for the release of 
OS/2 2.1 in 1993. Those of you who are interested in all of the technical details of 
the OS/2 2.1 product should look at the OS/2 2.1 Technical Update (IBM, 1993). 

With the Windows interface, you can tell that certain parts of an interface are 
disliked by users when supplemental utility programs are developed to improve 
the interface. The most disliked features in Windows are the Program Manager 
and File Manager. In OS/2, most of the difficulties were in the usability of menus 
and the number of steps users had to go through for tasks that could be accom¬ 
plished by direct manipulation. 

The desktop pop-up menu was enhanced to include a choice to open the 
System Setup folder directly from the pop-up. This provides a quick way to ac¬ 
cess the frequently used setup utilities for OS/2. Also, any program objects can 
now be added to the desktop pop-up menu or to the pop-up menu of any folder 
or any object that has a Menu page in the object's Settings view. Simply open the 
Settings view of an object to the Menu page and drag the icon for a program ob- 
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ject to the Actions on menu list box. The name of the program will display in the 
list box and will now appear at the bottom of the pop-up menu for the object. 

OS/2 2.1 improved workstation security by providing an option to lock the 
system automatically on system startup. The desktop setting Lockup section now 
contains a check box for Lock on startup. If this is selected, OS/2 automatically 
locks the system on startup. Previous lockup versions could be circumvented by 
rebooting the system. However, be careful. If users forget their password, then 
there is no way to reset the password except by reinstalling OS/2 2.1, since the 
system will always prompt for a password even when the system is rebooted. 
These are the pitfalls users have to watch out for when they take advantage of 
techniques provided them by system designers who follow the principle of letting 
users be in control! 

Users who have a CD-ROM drive on their system will see the pop-up menu 
for this drive now has software eject, lock, and unlock options. This allows users 
to perform these actions on the screen, rather than having to go to the CD-ROM 
drive itself. The CD-ROM icon is also now always present, even if no compact 
disc is in the drive. 

With OS/2 2.0, one of the most strongly disliked aspects was the number of 
steps users had to follow to change icons for objects and the non-intuitiveness of 
the process. The method to change icons in OS/2 2.0 took as many as 12 steps to 
simply replace the icon for an object. Users first had to open up the Settings view 
of an object, then go to the General tab of the notebook. To access other icons, 
they had to select the Find push button, which brought up a Find dialog, which 
wasn't very intuitive. Contrary to the design principles, users had to know where 
they kept their icon files on the system. Once any icons were found, they were 
displayed in the Find Results window. Selecting an icon and pressing OK then 
changed the current icon for the object to the new icon. 

Other developers had already seen the problems with the OS/2 2.0 tech¬ 
niques for changing icons. One company, American Computer Technologies, Inc., 
developed a product called Icon EXPRESS that provides quick and easy direct 
manipulation of icons for objects. The product provides over 1,000 icons and also 
helps users organize their icons. A later release will even allow users to animate 
icons and pointers. Figure 8-27 shows the Icon EXPRESS product. 

Following these cues, OS/2 2.1 users can now simply drag any object and 
drop it on the Current Icon area of an object's Settings view on the General tab 
page. This will immediately change the current icon for the object to the icon that 
was dragged there. 
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Figure 8-27. Changing Icons with Icon EXPRESS 

Let me show you how easy it is for developers to design dif¬ 
ferent interfaces for the same task. I just described how the new drag and drop 
technique for changing object icons was implemented in OS/2 2.1. It seems to be 
consistent with the source-target approach I've outlined for most direct manipu¬ 
lation tasks. You drag an icon (source) to the object settings (target) that you wish 
to change. It is similar to copying or moving an object from one folder to another. 
Here you are taking an icon and copying it to an object as its new icon. 

Icon Express implemented the task somewhat differently. First of all, users 
don't have to open an object into a Settings view to change the icon. This elimi¬ 
nates a number of steps immediately on the front end, which is a great idea. 
However, to change icons, users must use the opposite approach, a target-source 
technique to accomplish their task. Users must drag the object to the icon in the 
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Icon EXPRESS notebook. It may make sense to the program's developers and 
some users to perform the task this way, but it seems to be inconsistent with the 
source-target model for the rest of the interface, as I've described it here. 

These differences may seem subtle and unimportant, but the reasons why 
interfaces are intuitive and easy-to-learn are because new tasks can be performed 
in similar ways to tasks users already know how to do. Which technique works 
better for you? It would be nice if both techniques were customizable so that us¬ 
ers could choose whichever method makes more sense to them, and then do both 
techniques in the same way. That would be putting users in control of the inter¬ 
face! 


KEY ID E A ! 


As with the proliferation of Windows utilities programs, look 
for OS/2 utilities, objects, and other "widgets" to show up in the computer 
magazines and on the shelves of software stores. These products will further 
improve the OS/2 interface and provide quicker and better ways for users to 
work with their favorite objects. These products will also show the OS/2 devel¬ 
opers where improvements and enhancements can be made in future releases of 
OS/2 operating system and user interface. 


While I'm discussing the notebook control used in the Settings view of all 
objects, there's a small change to the notebook visuals I'd like to tell you about. If 
you're familiar with OS/2 2.0, you know that all notebooks have a solid gray 
binding. IBM CUA user testing showed that a spiral binding was more recog¬ 
nizable and well-liked by users. However, at that time, IBM attorneys didn't 
want us to use the spiral binding on notebooks because they thought it might be 
too close to the visual design used by Apple. So they changed the visual for the 
notebook to use a solid binding. As it turned out later, there weren't any legal 
problems with the notebook visuals, but at that point it was too late to change 
back to the spiral binding. So the notebooks used in the OS/2 2.0 interface all 
used the solid binding. However, the notebook control itself was designed so that 
developers could use either the solid or spiral binding in their products. OS/2 2.1 
went back to using the spiral binding for all system object notebooks, and product 
developers can still use the binding of their choice (or better yet, their user's 
choice!). 

User feedback led to another usability improvement in the OS/2 user inter¬ 
face. The first time a container such as a folder or workarea is opened, the win¬ 
dow is opened in a default size and position. Users, of course, may resize and 
place the window wherever they choose. After closing the window, it will then 
open in that size and at that location whenever that object view is opened again. 
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User feedback was that the default window size for an Icon view was too large 
for most folders users worked with. The windows took up too much of the desk¬ 
top screen space. IBM developers calculated how many objects were in the OS/2 
2.1 system folders and determined the best default size for an Icon view window. 
The goal was to provide a window big enough to show all of the icons without 
users having to scroll the window. As a result of user feedback, the default Icon 
view window size for folders in OS/2 2.1 was changed. It is now shorter in 
height and longer in width to make better use of the desktop screen space. 

OS/2 2.1 also provides multimedia image, audio, and video capabilities 
packaged with the operating system. MultiMedia for Presentation Manager/2 
(MMPM/2) provides audio enhancements to the user interface even for PCs that 
might not be equipped for multimedia, using the built-in PC speaker. I'll discuss 
this multimedia support in depth in Chapter 10. 


K E Y I D E A 1 


I wanted to give you some insight into the background be¬ 
hind these changes to the user interface between version 2.0 and 2.1 of OS/2. 
This shows you how user feedback and the development of other interface utility 
programs can provide valuable input to product developers and can affect the 
evolution and usability of a user interface. 


OOUIs and OOP: Similar, Yet Different 


"In the last three years, nearly a thousand product announcements 
have included the magic phrase 'object-oriented. ’ The pace is still 
accelerating: In 1992 alone, PC Week Labs estimates that there will 
be more than half again this number. When a label is used this broadly, 
some precision is lost. What, precisely, are the components of an 
object-oriented technology, and why should end users care?" 

Peter Coffee, 1992 


Many people confuse object-oriented user interfaces (OOUIs) with object-oriented 
programming (OOP). They are very different, but related, areas that will become 
more related and less different as time evolves. At this time, there is no causal re- 
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lationship between OOUIs and OOP; just because one of them is found in a 
computer system, it doesn't necessarily mean the other is there also. Object- 
orientation can apply at both the interface level and at the programming level, but 
they don’t mean the same thing, and their audiences are very different. 

The main thing to remember is that I'm talking about two very different 
worlds; the programmer's world and the users' world, as you've seen from my 
discussions. Programmer objects do not necessarily correspond to user objects. 
Object-oriented programming environments can enable OOUI development, 
however, OOUIs can be built using more traditional procedural languages and 
development tools. That is, an OOUI doesn't require OOP! 

At the same time, an object-oriented programming environment doesn't 
mean that an object-oriented interface must be or will be developed. That is, an 
OOP environment doesn't necessarily provide an OOUI. 


KEY IDEA! 


Good user interface design, even object-oriented design, 
should be somewhat independent of the underlying programming environment. 
The goal should be to build the best and most appropriate user interface for a 
product, regardless of the hardware and software environment. However, in the 
real world of computing, user interfaces are commonly "the tail trying to wag the 
dog." The more realistic goal is to build as good a user interface as possible, 
within the constraints of the hardware and software programming environment. 
The interesting question is, what if users need and want a better user interface 
than can be built by the developer's current programming environment, tools, 
and resources? Who wins in this situation? Unfortunately, the limitations of the 
programming environment and the development effort usually end up producing 
a less than optimal user interface. Developers win, users lose. 


The problem with object-oriented programming is that it is a new computing 
paradigm. Even skilled programmers in other procedural-oriented programming 
environments must learn new skills and techniques to become experienced in 
object-oriented analysis, design, and programming. It is also not easy for user in¬ 
terface designers to move to the object-oriented interface paradigm, partly due to 
a lack of nontechnical prototyping tools for building object-oriented interfaces. 
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OS/2: An OOUI and an OOP 


Let's look at OS/2 as an example. The user interface (the OS/2 Workplace Shell) 
is most definitely an OOUI, as I've discussed in detail in this chapter. IBM's Pre¬ 
sentation Manager is the underlying system that presents information on the 
screen and handles user interaction. Presentation Manager provides an event- 
driven (rather than procedural) programming environment for object-oriented 
development. 

Today's application-oriented programs are mostly hierarchical and proce¬ 
dural systems that were built to provide specific functions for specific users. Ob¬ 
jects in object-oriented programs are standardized parts that are designed to fit 
and work together in many different situations. IBM's System Object Model, or 
SOM, is the object technology underlying OS/2's object-oriented user interface, 
the Workplace Shell. SOM provides the operating system services that manage 
the creation and maintenance of program objects. By providing object manage¬ 
ment services at this level, rather than at the language level, OS/2 offers devel¬ 
opers unique benefits, such as the ability to access object libraries across pro¬ 
grams. From the user's perspective, SOM can be used to provide users with 
real-world objects rather than applications at the interface level. SOM is being 
developed to run across hardware and software platforms. 

Taligent, IBM's joint venture with Apple Corp., will also provide additional 
object-oriented technology in the OS/2 programming environment. There are 
many good books and articles on the topic of object-oriented programming, so I 
won't attempt to cover object-oriented programming in any detail here. 

OOP tools can use OOUIs themselves. The goal of all product development 
tools should be to enable both programmers and non-programmers to visually 
build graphical and object-oriented user interfaces. Digitalk Inc.'s PARTS, 
ParcPlace Systems' VisualWorks, and IBM's SOMobjects Toolkit are examples of 
highly-sophisticated OOP tools with object-oriented interfaces for their products. 


OOUIs and OOP: Beware of the Hype 

Object-oriented programming and the OOP acronym are fast becoming popular 
buzzwords in the computing environment. A Business Week special report 
(Schwartz, 1993) talks of new approaches to software development that are start¬ 
ing to get big results, "And just on the horizon are potentially huge gains from 
innovations such as object-oriented programming, a method for creating intuitive 
software out of prefabricated 'objects' that behave like objects in the real world." 
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Not without an object-oriented user interface, they don't! My observations and 
experiences are that as programmers get more sophisticated software technolo¬ 
gies and tools, they then have new and exciting ways to build even worse user 
interfaces than they had built before. OOP skills don't necessarily make a program¬ 
mer a skilled OOUI designer. 

The reader's imagination is further stimulated by another prophesy, "In the 
future, software will be even easier to create and use, thanks to object-oriented 
programming. At the Center for Advanced Technologies, individual program¬ 
mers are achieving 100% leaps in productivity via such methods, says Jerrold M. 
Groshow, the lab's director." Note the reference that OOP will provide easier cre¬ 
ation of software and software that is easier to use. As Porgy sang to Bess, "It ain't 
necessarily so!" 

Again, before I leave this topic, don't fall into the trap of merging the areas of 
object-oriented interfaces and object-oriented programming. They are both new 
technologies, but their benefits are geared toward different audiences, users and 
programmers. Going back to the car example I've used earlier, OOP is similar to 
having new and better ways to build the guts of an automobile inside, but they 
aren't readily observable to the driver of the car. They provide a better working 
environment for the car designer and builders. OOUIs are the ways users are 
given buttons, knobs, dials, and objects to work with to do what they do with 
cars, that is, get from one place to another. Users want and deserve the best of 
both worlds in their cars and in their software; something that runs well under 
the hood, and an interface that hums, too! 


Is OS/2 an OOUI Ahead of Its Time? 


"Personal computing changed the way the people worked. 
Object computing will change the way the world works. 
It is the wave of the future and it is here today 

Philippe Kahn, 1993 


Most of the software available today, in the DOS and Windows environments, is 
definitely application-oriented, and much of it is just now implementing graphi¬ 
cal user interfaces. Object-oriented programming techniques are also just now 
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"We're definitely object-oriented." 


being incorporated into popular development tools across all software operating 
system environments. 


The OS/2 Nay-Sayers 

Most negative feedback on the OS/2 user interface focuses on the fact that it is 
different from preceding interfaces. Users are very hesitant to change, even 
though a new working style may be more natural for them in the long run. Even 
Microsoft is moving toward object-oriented interfaces down the road. Computer 
interface metaphors, such as the spreadsheet and the desktop, will cause users to 
readjust how they work with computers, which means some kind of change. 
That’s been the biggest criticism of users of OS/2's user interface. 
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Many of the first reviews of the OS/2 2.0 product described the Workplace 
Shell interface as something entirely new and confusing to users. However, as 
even the critics really started using the interface, they realized that it perhaps was 
confusing not because of what it is, but where they had come from. I'll go into the 
testing results in more detail in the next chapter. 

Salemi (1992) wrote, "The Workplace Shell is sufficiently different from ex¬ 
isting PC-based GUIs that it will require some relearning. Its object-oriented ap¬ 
proach forces users to think about things differently. Macintosh users and those 
coming to a PC-based GUI for the first time may have an easier time adapting to 
the WPS than users already accustomed to Windows or Presentation Manager." 


KEY IDEA! 


It's unfortunate that the GUI-OOUI war is being fought on the 
marketing battlefield. Looking at just the user interfaces involved, it really is a 
user interface evolution we are talking about, rather than a user interface revolu¬ 
tion. Probably the biggest drawback to the OS/2 Workplace Shell and the OOUI 
is that it really does require a paradigm shift from many of today's GUI products. 
It is a strange situation, but because the popular GUIs don't mirror the real world 
very well, it takes time for users of these systems to get used to something that 
more closely matches the way they work in the real world. Strange, but true! 


There are a huge number of customers and users stuck in the beginning or 
middle stages of the move to GUI platforms and interfaces, and many aren't 
ready to move up to the object-oriented programming or interface arena quite yet. 
The problem is that the more they get entrenched and comfortable in the popular 
GUI environment, the more difficult it may be to migrate to the next level. 


The OS/2 Yay-Sayers 

"I think OOUIs will provide the killer applications that differentiate OS/2. 
Once you start using one , there's no going back to GUIs. OOUIs are 
really fun—the problem is that very few developers know how to create 
them on OS/2....There's a steep learning curve , but it's worth it. 

It was the same with the Macintosh™ a few years ago." 

Robert Orfali, 1992 

The growth of OS/2 and object-oriented product development is strong in the 
small business and corporate environment. Corporate America is now realizing 
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that their flagship applications are hopelessly mired in outdated hardware and 
software technology. Colin Cook, a senior technologist for Citicorp is quoted as 
saying (Verity, 1993), "The tragedy of the '70s and '80s was that we poured cement 
over everything with our systems." 

A number of books address migration issues for object-oriented product and 
interface development in client/server environments. Orfali and Harkey's (1992) 
book, Client/Server Programming with OS/2 2.0, won the 1992 OS/2 book of the 
year award from OS/2 Monthly magazine. It was recently updated in its third 
edition to address OS/2 2.1 (Orfali and Harkey, 1993). Shafe (1992) presents a 
management guide to client/server computing from the perspective of an OS/2 
tool vendor. The goal of the Van Nostrand Reinhold OS/2 Computer Library is to 
provide insightful and applicable information for this environment. 


What's Next for OS/2 and OOUIs? 

One of my favorite phrases about the evolution of user interfaces when I teach 
user interface design classes is, "The 'C' in CUA doesn’t stand for Cement." De¬ 
signers and programmers are working with the latest user interface architectures, 
guidelines, enabling tools, and operating systems to develop new or improved 
product interfaces for their customers and users. Meanwhile, user interface ar¬ 
chitects are already developing newer versions of user interface technology that 
will gradually work their way into operating systems and tools. This catch up 
mode begins again. I discussed this early in Chapter 2 and called it the software 
technology cycle. 

OS/2 2.1 is becoming more familiar every day to designers, programmers, 
and users. The IBM CUA user interface group in Cary, North Carolina is busy 
working on the next release of the CUA user interface guidelines. They should be 
published early in 1994. Look for it in your local bookstore! Some of the items to 
look for are menu enhancements, such as tear-off menus and enhanced pop-up 
context menus. The composite document architecture will also be enhanced. 
Also look for interface guidelines for pen computing and time-based media 
(multimedia audio and video). 

Meanwhile, IBM is working closely with a new organization to converge on 
a common set of user interface standards and guidelines. The Common Open 
Software Environment (COSE) was founded in March 1993 with the goal of de¬ 
veloping a common desktop user interface environment on multiple platforms. 
The participating companies are IBM Corp., Hewlett-Packard Co., Santa Cruz 
Operation Inc., Sun Microsystems, Univel Inc., and Unix Systems Laboratories 
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Inc. The key to their success is an underlying objective of making the COSE user 
interface vendor-independent. 

IBM plans on expanding the object-oriented Workplace Shell user interface. 
Workplace OS is targeted to run on multiple platforms. Microsoft is introducing 
its Modular Windows for the low-end DOS and home consumer computing de¬ 
vices. IBM is working on a new version of DOS with an object-oriented Work¬ 
place Shell interface, called Workplace DOS. 

The 1994-96 timeframe is the focus of the Taligent operating system. Origi¬ 
nally the "Pink" project in the Apple development laboratories, Apple and IBM 
decided to join forces in an attempt to leapfrog the current graphical interface and 
programming environment and build an object-oriented operating system, pro¬ 
gramming environment, and of course, user interface from the inside out. 
Object-oriented technology from the Taligent project is now beginning to be 
implemented in both IBM’s OS/2 and Unix environments. By the way, do you 
know the origin of the Taligent name? The official explanation is that Taligent is 
extracted from the words Talent and intelligent. Others note that Taligent is also 
the combination of Talent without the NT (a reference to Microsoft's new operat¬ 
ing system) and intelligent without the INTEL (the chip-producing company). 

Are object-oriented interfaces, as we know them today, the ultimate user in¬ 
terface for the future? Most everyone agrees that they are not, but object-oriented 
interfaces are still in their infancy stages. It is very difficult to find outstanding 
GUI or OOUI product interfaces. Users can look forward to many years of re¬ 
search, development, and end-use as OOUIs evolve to help users be more pro¬ 
ductive. OOUIs should also help make computers less technical and phobic for 
users as computers becomes more and more complex. Then, hopefully, we'll be 
primed for another paradigm shift. Collins (1990) points out, "New technologies, 
and new ways of understanding users, will produce systems that will make 
today's interfaces look slow and clumsy by comparison. But today's best inter¬ 
faces are too seldom found. Users are too often saddled with interaction tech¬ 
niques based on obsolete technology. Inventing a better future for them is up to 
us." 

The final chapters will take you into the future of computing and how it will 
affect users and the ways they will interact with computers. 
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NINE 


GUIs and OOUIs: 
What the Tests Show 


"Left to our own devices, we will 
-pay more attention to things of less 
importance to the customer. 


Ron Zemke, 1992 



The Marketing Aspects of Usability 


" It's not surprising WordPerfect users are switching to 
Microsoft Word for Windows. They helped define it." 

Microsoft Advertising, 1993 


The buzzword on every computer user's lips today is benutzerfreundlichkeit (at 
least in Germany). That means user-friendliness. And, as I discussed in the be¬ 
ginning of this book, both hardware and software manufacturers are doing their 
best to convince consumers and customers that their product is friendlier than 
their competitor's product. 

As a part of this marketing approach, they are at least educating the public to 
the area of usability testing. Here's a quotation from the Microsoft advertisement 
discussing why Microsoft Word is better than WordPerfect Corporation's 
WordPerfect: "During the development of Word for Windows, we invited 
WordPerfect users to try it out on the things they do every day at work. We call 
these types of sessions 'usability studies.' They help us find out the way in which 
people use their computers, and how we can make it easier for them." The ad 
goes on to state, "We even had the National Software Testing Labs put Word for 
Windows to the test in ten cities across the country. The result was that nearly 8 
out of 10 WordPerfect users preferred Microsoft Word for Windows for ease-of- 
use over WordPerfect for Windows." Be sure to read very carefully when you see 
these advertisements. What you read isn't necessarily what you get. 


The Art of Data Massage 

Of course, advertisers want readers to take these test results at face value. I’m 
waiting for the WordPerfect advertisement to quote a study of their own showing 
exactly the opposite results. The problem is, as I just discussed, one of test reli¬ 
ability and test validity. I'm sure these tests are fairly reliable, but I'm not sure 
about their validity. As a usability professional, I know that it is very easy to de¬ 
sign scenarios and tasks that will favor a technique or function in one product 
over similar aspects of another product. Also, the types of measures used in a test 
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Product A-Product B 
Usability Comparison Study 


Product 

Completion 

Errors 

User 

Tested 

Time 

Made 

Satisfaction 

A 

44 minutes 

6 

7.3 (1-10,10 high) 

B 

67 minutes 

3 

7.2 (1-10,10 high) 


Figure 9-1 . Sample Usability Test Results 


can change test results drastically. I told college students about "the art of data 
massage" in a course I taught titled. Fundamentals of Psychological Research. 

For example, let's say we conducted a usability test and found the results 
shown in Figure 9-1. Evaluators of Product A completed a task, on the average, 
in 44 minutes and they made approximately 6 errors. They gave the product a 
score of 7.3 on a user satisfaction questionnaire. Product B evaluators took longer 
to finish the task-67 minutes-but they made only 3 errors. They gave the product 
a 7.2 satisfaction rating. There are more complicated statistical analyses that must 
accompany these numbers based on the number of test evaluators and their 
ranges of scores. I won't go into these here. The numbers you see in the chart are 
typically the types of results you see in product advertisements and brochures. 

So what are our test conclusions? Which product is more usable? Well, it 
depends. It depends on what the operational definition of usability is for the test. If 
usability is defined as task completion time. Product A is obviously more usable, 
since it only took 45 minutes as compared to Product B's 60 minutes. However, if 
usability is defined as the number of errors made during the task, then Product B 
is more usable, since only an average of 3 errors were made using the product in¬ 
stead of 6 errors with the other product. Finally, usability might be defined as the 
evaluators' satisfaction with the product. In that case, there really is no difference 
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in usability for the products, since the differences between the satisfaction scores 
is minimal. Well, are you confused yet? Now you see that each operational defi¬ 
nition of product usability results in a totally different conclusion from the test. 
This is why readers should take test results very lightly, especially when they are 
found in product ads or brochures. 

Journalists and users are becoming more sophisticated in their understand¬ 
ing of the usability claims pronounced by software developers. An article in PC 
Week titled, "Let Buyers Beware of the Limits of Usability Testing" (Rossheim, 
1993) discusses these exact issues I demonstrate here. Their recommendations 
were, "First, beware of the gleaming badge of scientific objectivity that vendors 
pin on the white lapels of their usability testers. Buyers should question assess¬ 
ments of users' work behavior that are made far from the context of their 
workplace...Second, consider the effects of the observers on the observed...Third, 
carefully examine claims that software packages have been designed for both op¬ 
timal ease of learning and maximum ease of use. What's easy to learn may be la¬ 
borious to use in the long run." 


User Interface Evaluation for Fun and Profit 


"We're talking about designing computer systems for ease of use, 
exploiting advanced new technology tools and formal methods 
which impact upon the bottom-line via lower total lifetime costs, 
higher profits, improved quality and more easily used end-products." 

Brian Oakley, 1991 


Sounds great, doesn't it? Products that are high-tech or new-tech, higher quality, 
easier for customers to use, and cheaper to develop. The question is, just how is it 
done? There are lots of ways to accomplish these goals, and some form of usabil¬ 
ity evaluations must be a part of each of the solutions. 

Usability testing isn't done just for the fun of it. It can be an eye-opening 
experience for developers to watch their product being tested. Be careful to keep 
developers from getting too involved in a usability test. Because they know how 
the product works, it is easy for them to cue test evaluators or to steer them to- 
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ward a solution when evaluators might not find it on their own. I do recommend 
that every designer and programmer should observe a usability test of their 
product. 

Usability testing should be an integral part of the product design and de¬ 
velopment process. However, it is often the victim of development trade-offs. Is 
usability testing worthwhile if the product delivery date is delayed three months? 
Some would say "yes" while others would say "no". Miller and Jeffries (1992) 
conclude, "As with most things, the more time and money you put into the 
evaluation process, the more likely you are to get a usable product. Beyond that, 
you—the person who knows the most about your situation-will have to deter¬ 
mine what trade-offs are acceptable." There are some key questions that must be 
answered: How can you get the biggest return on your evaluation efforts? How 
do you know when you have done enough evaluation? How much risk of being 
off-target with your customer's needs are you willing to take? 

Usability testing and evaluations should be part of the cost of doing busi¬ 
ness. As with other business costs, there is probably a return-on-investment and a 
higher profit due to a better quality product and a more usable product. Figuring 
out how much product savings usability testing can provide is difficult, but there 
are cost-justification models available that can be used to determine the value of 
testing. At Ford Motor Company, it was determined that the company’s usability 
program saved them $100,000 on an accounting software system, which more 
than paid back the company's initial investment of $70,000 in the usability labo¬ 
ratory (Kitsuse, 1991). 

Usability laboratories have been around for fifteen years. Kitsuse (1991) de¬ 
scribed their history, "The usability evaluation process was developed by IBM 
Corporation in the early '80s as a way to make personal computer users more 
self-sufficient and to cut down on the number of calls to the company's 800- 
number help-line. The process has since been adopted by most major developers 
of hardware and software, and over the past two years, has found its way into a 
growing number of smaller software firms. Large companies that custom-design 
software for use by their own employees are also experimenting with usability 
evaluations." 


KEY I D E A ! 


I've already discussed the role of human factors and usability 
professionals and the importance of usability testing in the product design and 
development cycles. There are many reasons why usability testing must be built 
into the development process. Here are a few basic reasons: 
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• Designer's and developer's intuitions about a product aren’t always 
correct. 

• Designer's and developer's terminology doesn't always match the 
user's. 

• People differ and therefore there is no "average" user. 

• Usability design principles and guidelines aren't sufficient. 

• Informal feedback is inadequate for product evaluations. 

• Time, money, and resources spent on usability evaluations are worth¬ 
while. 

• Products built in pieces will usually have system-level inconsistencies. 

• Problems found late in the process are more difficult and more expen¬ 
sive to fix. 

• Problems fixed during development will mean reduced support costs 
later. 

• Usability evaluations can provide advantages over competitive prod¬ 
ucts. 

All aspects of a product can't be fully tested. Developers must decide what 

areas of usability to focus on and must prioritize their users' requirements for the 

product. The major areas of usability focus are: installation, learning, use, and 

productivity. 


Computers and Documentation: What Are You Afraid Of? 


"No matter how powerful the computer or how far-reaching the 
information network, it means little if the average office worker 
can't use it. Improved software is key to making information 
technology accessible and businesses more productive." 

Evan Schwartz, 1993 


Throughout this book I’ve described the sometimes painful migration from older, 
character-based user interfaces to the GUIs and OOUIs available today. I've been 
honest and shown you the costs associated with this hardware and software mi- 
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gration. I've also mentioned several studies showing the productivity gains users 
experience when moving to graphical interfaces. Some of these studies are of the 
sort I've just described above and should only be taken at face value. Other, more 
significant studies are of interest and I'll discuss them here. 

Here are a few of the basic questions the research has focused on. What are 
the benefits of GUIs and OOUIs? What are the psychological and social effects of 
different interfaces on users? How do user interfaces affect learning and produc¬ 
tivity? Let's look at some of the major areas of research. 


Computer Anxiety 

Many first-time and novice computer users are afraid of the computer. They may 
be afraid of what they might do to the computer or even what the computer 
might do to them. One IBM study (Carroll and Mazur, 1986) addressing learning 
to use the Apple Lisa computer reported, "For example, learners often fear that 
they will damage the system. As one learner said, 'Will I damage this if I turn it 
off with the disk in? I have a terror of destroying things, so I'm still a bit tenta¬ 
tive.' " This user already had four hours of experience with the system. 

Other studies directly investigate the area of computer anxiety. The study of 
computer anxiety began in the early 1980s when personal computers began infil¬ 
trating the work areas of the United States. Although computers are now very 
common, especially in the office environment, the fear and hatred of computers is 
still prevalent. Many users have rational fears related to using computers, such as 
job displacement, repetitive stress injuries such as carpal tunnel syndrome, and 
even exposure to radiation from computer display screens. Other fears might be 
called irrational, such as feelings of impending doom or sure calamity because of 
contact with computers. 

Many studies addressed the impact of computers in schools and universities. 
For example, remember the technoculture dilemma (Mac vs. PC) I discussed in 
Chapter 2? Studies have titles such as, "Initial Effects of Word Processing on 
Writing Quality and Writing Anxiety of Freshman Writers" (Teichman and Poris, 
1989). This particular study concluded, "What is clear from our data is that word 
processing does not diminish writing quality among new users, despite the fact 
that the student must learn new skills and adjust to a new way of writing." They 
also noted that the one-semester study was probably not long enough to see if 
using computers could significantly improve students' essay writing. Computers 
have become a social and psychological area of study as the technology has in¬ 
vaded, and problematically enhanced, our lives. 
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Do Users Read Computer Documentation? 


One of the problems with both computer hardware and software is that they are 
almost always accompanied by documentation. All areas of product usage are 
usually fully documented, including installation, learning, user guides, reference 
materials, helps, and problem determination information. Much of this product 
information is slowly being moved from hardcopy manuals to online information 
today so users have the appropriate information immediately available while 
they do their work. 

The problem is that most of the research in this area, and general experience 
with users during testing, tell us that people don't read computer documentation, 
regardless of whether it is necessary information for completing work or whether 
it is support or help information. After years of usability tests, it is clear to me 
that there are different types of users: those who won't read the documentation 
even if told to do so, those who read the documentation only when they can't 
figure out what to do on their own, and the rare case of individuals who will read 
information carefully before trying to do anything on the computer. 

Product documentation, including installation information, help, tutorials, 
messages, and any other support information for the product, should all be consid¬ 
ered part of the user interface for the product. Don’t forget to address these parts of 
the product when designing usability tests. 


Benefits of GUIs 


"GUI users work faster, better, and have higher 
productivity than their CUIcounterparts." 

Temple, Barker & Sloane, 1990 


Over the past few years, there have been a number of studies specifically looking 
at the benefits of graphical user interfaces (GUIs) over traditional character-based 
user interfaces (GUIs) for typical user tasks. In Chapter 7, I discussed two major 
CUI-GUI studies, the Wharton Report (1990) and the Temple, Barker & Sloane 
(1990) study The latter study was cosponsored by Microsoft Corp. and Zenith 
Data Systems. The stated goals of the commissioned work were to "...develop a 
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research program designed to rigorously validate the benefits of GUI and com¬ 
mon user access (CUA) in the white-collar environment." 

The study was conducted from November 1989 through April 1990. The 
GUI environment was represented by IBM-compatible PCs running DOS. The 
GUI environment was tested with novice and experienced users using a mix of 
computers running Macintosh and Windows interfaces. The report did not pro¬ 
vide specifics on the versions of DOS and Windows, but assuming that they used 
commercially available versions of the products, they would have used DOS 4.0 
(available in 1989) and Windows 2.1 (Windows 3.0 was not announced until May 
1990). The GUI user interface guideline followed by Windows at this time was 
IBM's CUA architecture. CUA 1989 was not published until June 1989. From the 
dates of the study and the versions of Windows systems used, the Windows GUI 
interface architecture tested was possibly as old as 1987. This means the study 
really doesn't tell us much at all about the GUI environment of Windows 3.1 and 
doesn't even address the OOUI environment, since OS/2 2.0 didn't come out until 
1992. 

Users were asked to perform two types of tasks: word processing and 
spreadsheets. The only information given in the report about the applications 
used was, "Application software packages available in the CUI and GUI envi¬ 
ronments are not identical in capabilities. Rather than attempting to assess the 
quality of competing applications. Temple, Barker & Sloane chose the packages 
with the greatest market acceptance among white-collar users." I don't know 
about you, but I'd like to know exactly what products were being used in the 
study! As a usability professional, I find it interesting that the report deliberately 
focused on the two types of interfaces at only a very general level, not even de¬ 
scribing the versions of the operating system environment and not even specify¬ 
ing the names of the applications used in the study. I’m not saying that the study 
wasn't reliable, but I question the validity of a study that only addressed the 
CUI-GUI environments at a very, very high level. You certainly can't automati¬ 
cally generalize their results to the graphical interfaces of today since they are 
many years ahead of the interfaces investigated in these studies. 

One conclusion of the study is of general interest. Based on the performance, 
observational, and attitudinal findings, differences in proficiency over distinct 
phases of familiarity with a given application were discovered. Figure 9-2 shows 
the differences between character-based interface users and graphical user inter¬ 
face users. These curves show that GUI users spend more time understanding 
the interface in early stages. However, they then quickly learn to explore aspects 
of the graphical interface, and ultimately become more proficient once the appli¬ 
cation interface is internalized. The CUI interface, on the other hand, shows 
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Figure 9-2. Development of User Proficiency, from Temple, Barker & Sloane (1990) 


easier learning in the very early stages, but only incremental improvement in 
proficiency over the exploration and application internalization phases. 


KEY IDEA! 


An easy way to get GUI users over the learning hump is to 
give them a fun and easy way to learn the basics of a graphical user interface, 
such as using the mouse to select, drag, and drop objects on each other and to use 
menus. There is one application that unobtrusively has been teaching novice us¬ 
ers how to use a GUI since 1990. It is Solitaire, the application that I (and many 
others) have said is the most often-used application in the Windows environment. 
Although often criticized as a time-waster. Solitaire has just been given an indus¬ 
try award for its "foresight" in getting people to use the mouse as a pointing de¬ 
vice. Schwartz (1993) told of the corporate view of Solitaire when it first came 
out, "...Solitaire proved so distracting that Boeing Co. and other companies re¬ 
moved it from all their PCs." But then, people found out that it helped users 
through the early learning curve, "When useful applications for Windows arrived, 
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workers had already mastered clicking and dragging on-screen objects-skills 
honed with Solitaire." PC educators and training specialists realize the impor¬ 
tance of early and enjoyable training and there are now many educational and 
entertaining products to help users learn the basic GUI and OOUI skills. 

As I get into the test results for OOUIs, you'll see that these trends described 
here for learning GUIs are also found in the object-oriented interface environ¬ 
ment. Much of the criticism of the OS/2's OOUI is that it is difficult to figure out 
initially. But most critics and users agree that over time it is a more powerful in¬ 
terface. These comments suggest that users really do follow the GUI proficiency 
curve described in this chart. In the next section I'll take a closer look at test re¬ 
sults for the OS/2 object-oriented user interface. 


OOUI Usability Tests 


The object-oriented CUA '91 user interface architecture underlying the OS/2 
Workplace Shell was thoroughly tested before the CUA 1991 interface design 
publications were released. IBM conducted a system-level usability test in June 
and July 1991, using 21 evaluators with various types of computer experience. A 
system-level test investigates general use of the whole interface rather than fo¬ 
cusing only on specific aspects of the product. This type of test is usually the last 
in an iterative series of more specific tests that build toward integrating all of the 
components of a product and the interface. The goal of the system test was to 
ensure that no moderate to severe usability problems were associated with the 
CUA interface architecture. 

These tests are usually not of interest to many people other than product 
designers and interface architects. However, test results like these should be of 
interest to those who wish to follow the evolution of graphical and 
object-oriented user interfaces and those who are curious about how and why 
user interfaces and products end up looking and working the way they do. 


OOUI Test Background 

Evaluators were obtained from a temporary agency (16 participants) and from 
IBM (5 participants). They were chosen to represent equally three user groups, as 
described in Figure 9-3. 
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Evaluators were asked to perform a series of 83 tasks using a prototype of 
the CUA '91 interface architecture. The tasks involved working with documents; 
standard container objects, such as folders and a wastebasket; and devices such as 
a printer and the A: drive. Product-specific views were designed for some of the 
objects. Each evaluator's performance was measured against a predefined set of 
criteria for the tasks. Here's a sample of some of the tasks: 

® Open a desktop object using a pop-up menu 
® Change the view of an open object to a Details view 

• Hide a window 

• Create an object by dragging from a template object 
® Print a document using the container menu bar 

Evaluators completed background questionnaires to begin the test. After a 
brief introduction to the usability test, they worked through a tutorial. This tuto- 
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rial was a shorter version of the tutorial available on the OS/2 product. They also 
were given a reference document titled, "More Information About the System," 
that they could use as they wished during the test. After completing the tutorial, 
evaluators were given a set of task scenarios. They were encouraged to perform 
all of their tasks without any help from test administrators. The tutorial and ref¬ 
erence document were available throughout the test. Evaluators were also asked 
to verbalize their comments (the talk-aloud technique) so test administrators 
could better understand what evaluators were thinking and doing throughout the 
test. This is a standard usability testing procedure that provides valuable infor¬ 
mation about evaluators and the tasks they perform. 

Task completion times, success rates, and satisfaction ratings were the us¬ 
ability data collected during the test. Evaluators were also videotaped to main¬ 
tain records for all tests and to serve as backup to other data collection tech¬ 
niques. Test administrators only provided help to evaluators if they requested it 
or if five minutes had passed and the task was not yet completed. After two more 
minutes, test administrators provided enough information for evaluators to 
complete the task, and the task was logged as a failure. 


OOUI Test Results 


All but one of the 83 tasks were successfully completed by evaluators. The ex¬ 
ception task asked evaluators to find information in another view of an object that 
was already opened. That one task proved to be confusing for evaluators because 
they were looking for information in different views of an object rather than the 
view where designers had placed the information. This result shows poor per¬ 
formance was probably due to product implementation rather than any problems 
with the interface concepts. 

Test evaluators were asked to rate their satisfaction at specific points during 
the test. They rated their satisfaction with the time required to do each task and their 
satisfaction with the way the system worked. Figure 9-4 shows the user satisfaction 
results for the test. Thirty-three of the thirty-six ratings meet the criteria of aver¬ 
aging at least a 5 on a 1-7 scale with 7 being very satisfied. The three below- 
average ratings were recorded very early in the test, from the tasks in the first 
scenario. Satisfaction ratings improved throughout the test, so much so that the 
last 8 ratings were significantly higher than the minimal criteria value of 5. 


KEY IDEA! 


Interestingly, these results mirror users' comments about their 
experiences with OS/2 2.0. Many users and reviewers expressed early confusion 


GUIs and OOUIs: 


What the Tests Show 


307 


7 

33 

Ratings 


1 1 j §§ 

3 

Ratings 

User 5 

Satisfaction 

3 

1 






Satisfaction Ratings 


Figure 9-4. User Satisfaction Ratings 


with the Workplace Shell interface, but after gaining some experience with the 
interface, they are much more positive and excited about the interface and how 
they can do their tasks. Part of the problem with the object-oriented Workplace 
Shell interface is that it is very different from the application-oriented interfaces 
users find in the marketplace today. The OS/2 interface was designed to give 
users as much control as possible. This new-found control can be confusing at 
times. Seltzer (1993) comments, "The Workplace Shell is extremely flexible. 
There's a way to do just about anything. In fact, there are probably three ways to 
do anything, and more ways to do two other things that are only subtly different." 

Any change in something users must work with every day, such as the op¬ 
erating system interface, will usually be met with initial resistance/but the ulti¬ 
mate test of a new and different product is whether the initial reactions change 
after continued use with the product. Both test results and user perceptions seem 
to show positive long-term user satisfaction with the OS/2 interface. 
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Key OOUI Design Issues 


Several interface design questions were investigated in this usability test. The test 
scenarios were specifically designed to address these issues. 111 present some of 
the key interface issues and their test results. As you’ll see, the results of these test 
issues have led to enhancements to OS/2's OOUI. 


Menu Bars vs. Pop-Ups 

The first usability issue addressed the use of menu bars and pop-up menus. I've 
already discussed how OS/2's objects don't have menu bars on their open win¬ 
dows. This was a surprise to many users who were accustomed to seeing a 
familiar-looking menu bar in every open window. The question is, do users really 
need menu bars in an open window, or are pop-up menus for objects in the inter¬ 
face more usable? In the test prototype, all windows had menu bars and all ob¬ 
jects had pop-up menus. The background area of opened windows and the 
desktop background also had pop-ups. 

Evaluators were asked if they could choose between using a pop-up menu 
and a menu bar menu, which one would they prefer to work with. Thirteen of 
the 21 evaluators said they would prefer working with a pop-up menu, while 
seven said they would rather use the menu bar. One evaluator expressed no 
preference. However, they don't want to be limited to only using pop-up menus: 
18 of 21 said they don't want menu bars removed. While these results show a 
preference for pop-up menus, users want to have a choice. It was recommended 
that menu bars should be made available in the interface and that users should be 
provided with the option of using menu bars or not, along with pop-up menus. 
Figure 9-5 shows an OS/2 window without a menu bar and with its associated 
pop-up menu. 


Mouse Access for Pop-Up Menus 

Another issue is the OS/2 mouse technique for accessing pop-up menus. The 
CUA ’91 guidelines recommend that simultaneously pressing mouse buttons 1 
and 2, or "chording," be used to access pop-up menus. There were some concerns 
that this would be difficult for users. This was the access technique implemented 
in the interface prototype. Test results showed that 5 evaluators were not sue- 
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cessful on at least one attempt to access a pop-up menu. Satisfaction scores 
showed that participants had an average score of 80 out of 100 on whether they 
agreed with the statement, "I found it easy to get to the pop-up menus." Al¬ 
though some evaluators had problems with the mouse technique, it was not a 
persistent problem. Later testing on the OS/2 2.0 user interface showed that us¬ 
ers did have more problems with the chording technique. A single-click of mouse 
button 2 was chosen as the default mechanism for accessing pop-up menus, and 
users can modify their choices for mouse techniques in the Settings view of the 
mouse object (Figure 9-6). The mouse button mapping feature shows that OS/2 
design used the results of multiple, iterative tests to provide the best default 
techniques and also to provide ways for users to customize their interaction 
techniques for the way they prefer to work with the interface. 
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Figure 9-6. Mouse Mappings for Accessing Pop-Up Menus* 


Techniques for Opening Object Windows 

Another usability concern is the expected result when users double-click (open 
the default view of) an object that is already opened (one that shows in-use em¬ 
phasis). Should the opened window become the active window or should a new 
default view be opened? Results showed the majority of the test evaluators ex¬ 
pected a new view of the object to be opened. Even though most of them ex¬ 
pected this, some preferred that the open window be surfaced. These test results 
led OS/2 developers to provide an option in the Settings view of each object for 
users to choose whether to display the existing window when the object is 
double-clicked or to open a new window. Figure 9-7 shows the Window settings 
page for an OS/2 object. Again, test results led to the development of user 
customization features for the object-oriented interface. 
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Figure 9-7. User Options for Open Window Behavior* 


Creating Template Objects 

The final issue I'd like to address is how to create objects from templates. Early 
versions of the CUA prototype used a simple drag (with mouse button 2) to create 
new objects from templates. Early testing showed some confusion in this area 
when users tried to move template objects or tried to reposition template objects 
on the desktop and found that they were creating new objects inadvertently. For 
this test the default drag action was changed to move and Crtl+drag was imple¬ 
mented as the technique to create new objects with direct manipulation. Test re¬ 
sults showed that there were no significant problems with this approach. How¬ 
ever, later testing on OS/2 showed that users preferred to be able to drag directly 
from a template object rather than having to use the Ctrl key along with the 
mouse every time they wanted to create an object. This does make the technique 
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inconsistent with all other non-template objects, where the default drag action is a 
move. 


KEY IDEA! 


Programmers and designers working with OS/2 and the CUA 
interface guidelines should strive for consistency both at the operating system 
level and at the product level. This means, follow the guidelines for most areas 
where OS/2 and CUA have the same techniques. In other areas, where there may 
be differences between techniques used or recommended by OS/2 and CUA, de¬ 
velopers should implement the most consistent technique for their environment. 
However, at the programming level, products must use logical messages rather 
than responding to particular mouse button events, so that users can customize 
their interface interaction techniques. This also allows any future changes to the 
OS/2 interface techniques to be reflected in the product rather than having to go 
back and recode any hardcoded button mappings. 


The Ten Most Common Usability Problems with GUIs and OOUIs 

Through research and practical experience, IBM usability professionals have 
compiled a list of the most common usability problems found across most 
graphical interfaces and object-oriented interfaces. The list should have some 
familiar themes if you have been involved at all in any usability efforts on any 
computer software project. The top ten usability problems in the list are: 

1. Ambiguous menus and icons 

2. Single-direction languages 

3. Input and direct-manipulation limits 

4. Highlighting and selection limitations 

5. Unclear step sequences 

6. More steps to manage the interface than to do tasks 

7. Complex linkage between and within applications 

8. Inadequate feedback and confirmation 

9. Lack of system anticipation and intelligence 

10. Inadequate error messages/help, tutorials, and documentation 

I have covered most of these areas at some level of detail in this book. As a 
user or product developer, you might agree with many of these problem areas 
from personal experience. No matter what operating system you use and what 
interface and product development tools you use, these are still the most prob- 
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lematic areas of user interface design found in software products today. I hope 
the interface principles, concepts, along with usability test results I've discussed 
will help you understand these areas of user interface design and will help you 
design and build better product interfaces. If you're a product user rather than a 
designer or programmer, let the product developers know your thoughts and 
feelings about their product's interface. Chances are, they could use the feedback 
from actual users of their product! 
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Multimedia: 

The Future? Or, Just 
New Technology ? 


"Multimedia: An expensive way to 
get computers to talk in clipped sound 
bites and display distracting video 
clips. In other words, a costly toy." 


Gina Smith, 1993 



Why All The Fuss Over Multimedia? 


There's a real possibility that multimedia will wind up being so 
overpromised and underdelivered that no one will be interested 
anymore when we finally figure out what it's all about ." 

Rory O'Connor, 1990 


Now that I've been telling you throughout this entire book that user-friendliness 
is the latest buzzword, there's a new technology around, and it's called multime¬ 
dia. Multimedia is the latest computer hardware and software craze. Hardware 
manufacturers are excited about it because multimedia requires newer, faster, 
bigger, and obviously more expensive hardware. Software developers are thrilled 
about multimedia because of the new programs and tools that can be built for it. 
Users are excited and thrilled, but most are still thoroughly confused and frus¬ 
trated by multimedia. There is so much hype about multimedia that it is difficult 
for most computer users to even figure out what the basics of multimedia are. 


Multimedia Defined 

"One goal of multimedia is to link and to present information in a 
manner more nearly like that we employ inside our own heads. 
That means pictures, sounds, words, and multidimensional links." 


John Anderson, 1989 


Actually, we all have been doing multimedia for years, but we didn't have a fancy 
technical name for it. When your fourth-grade teacher played some music on the 
record player and asked you to write some words to go along with the music, you 
created some multimedia. Basically, multimedia is the combination of informa¬ 
tion of different types. Webster defines it as the use of several media as a means 
of conveying a message. The types of information that can make up multimedia 
computing include text, graphics, sound, animation, and video. 
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Buxton (1990) rightly comments that discussions of multi- 
media as an emerging technology usually have a circular quality. The first dis¬ 
cussion statement is "Multimedia is the future." The corresponding question is 
"What is multimedia?" So, the confused discussion carries on from there. Buxton 
suggests that we use more appropriate and focused terms when discussing mul¬ 
timedia. The use of these terms can better help define and distinguish how mul¬ 
timedia works with the various human sensory mechanisms. The terms are: 

• Multisensory: using multiple sensory modalities 

• Multichannel: using multiple channels, of the same or different modali¬ 
ties 

• Multitasking: recognizing that people can perform more than one task 
at a time (such as everything we do while driving a car) 

Buxton goes on to show how we aren't very accurate in our interface defini¬ 
tions. When we say "hands-on" computing, we really aren't allowing multitask¬ 
ing using the keyboard and mouse. Users can't really do two things at once with 
their hands, such as scroll a document and select text at the same time. Some 
high-end systems allow this type of interaction, but the mainstream PC market 
has yet to incorporate these interaction concepts. 

The combination of different types of information in meaningful ways can 
serve to improve learning by involving more of the human senses and also by 
making the computing experience much more interactive and enjoyable. As I 
discussed earlier, the human perceptual and cognitive systems are capable of re¬ 
ceiving input from various senses simultaneously. The human brain is capable of 
creating multiply-coded meanings that are stronger and more memorable than 
singly-encoded information. Put simply, we understand something better when 
we can receive multi-sensory information. A common, yet somewhat unscientific 
phrase you may have heard is that we can remember 20% of what we hear, 40% of 
what we see and hear, and 75% of what we see, hear, and do. This gives you an 
indication of the power of interactive multimedia. The goal is to make the mul¬ 
timedia computing experience as close as possible to what goes on inside our 
own heads, hence redefining user-friendliness. 


Why Hasn't Multimedia Caught Fire? 

Why hasn't multimedia caught on so quickly with the average user? When word 
processing and desktop publishing arrived on the PC platform, the set of skills 
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Figure 1 -1 . Multimedia on the PC* 


needed, to use the programs increased. The results that could be obtained with 
these new programs were enticing, but users needed some understanding of page 
layout, typography, color, and book design. Many novice users spent a lot of 
money and effort on computer hardware and software to do desktop publishing, 
only to find that it was beyond their capabilities. 

Multimedia takes the complexity of the computing environment to a much 
higher level. With word processing, users needed to understand how to work 
with text. Now users will have to understand audio, graphics, animation, and 
video, and will have to have the programming and artistic skills to combine them 
all into an appropriate package for other users. Multimedia makes desktop pub¬ 
lishing look like child's play. Figure 10-1 shows some of the elements of multi- 
media computing in the PC environment. 
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Multimedia is still in the early stages. Today's multimedia products, such as 
the well-known IBM Illuminated Manuscripts Series ( Ulysses, Hamlet, Black Elk 
Speaks, The Declaration of Independence, and A Letter From a Birmingham Jail), are all 
created by a few talented professionals using extremely advanced multimedia 
technology. These products are meant to be viewed by a select audience with 
multimedia capable computers. This is the few to many type of multimedia envi¬ 
ronment. The main goal is for multimedia presentations and products to become 
easy enough to develop so that we have a many to many multimedia computing 
environment. This ultimately means that anyone should be able to create a mul¬ 
timedia presentation that anyone else can view. That's when we really will have a 
groundswell of multimedia activity. 


KEY I D E A ! 


The hope is that multimedia will make computing easier and 
more user-friendly, so that the computer will be more like the friendly television. 
Unfortunately, computer multimedia is more like the unfriendly VCR attached to 
the friendly TV. The most important feature of any technology , including multi- 
media, that contributes to ease-of-use is the user interface. Because of the very 
nature of multimedia, with its combinations of many complex types of data, it is 
even more important to have a well-designed interface. Throughout this book 
you've seen examples of poorly-designed interfaces. As I discussed with the use 
of color, more is not necessarily better for users. Now with the explosion of mul¬ 
timedia, I've seen just how easy it is for developers to create even worse user in¬ 
terfaces using more and different types of information. 


You'll see after reading this chapter that the explosion of graphical user in¬ 
terfaces has paved the way for multimedia technology to work its way onto the 
desktop. You'll also see the object-oriented user interface is a perfect environment 
to gracefully merge multimedia into the current interface where users can easily 
work with data and objects composed of different types of information. 


Who's In Charge of Multimedia? 


"It's sort of like being in a foggy harbor with lots of ships coming 
from different directions, in the night at top speed, and a collection of 
captains who would make the chap on the Exxon Valdez seem reasonable. 

Marc Porat, 1993 
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As with any new technology, the rush is on for companies to gain control of areas 
of the multimedia marketplace and then quickly proclaim that their product is 
now the standard for that area of the multimedia industry. The truth is, there is 
going to be a lot of jockeying for position with regards to standards while the 
multimedia industry is still maturing. While most of the standards work relates 
to the underlying media technology and data formats, there is little agreement as 
to multimedia user interface elements. 

As an emerging technology, multimedia suffers from a lack of agreed-to 
standards, from competing standards, and from the general complexity involved 
in multimedia. Currently, there is a mix of international standards committees, 
consortiums of companies, and de facto industry standards that are all simulta¬ 
neously competing for control of multimedia hardware and software standards. 

Every few weeks there is news of new multimedia ventures, spin-off com¬ 
panies, and consortiums of companies banding together to gain power. Multi- 
media has all the signs of another many-faceted computing domain where, un¬ 
fortunately, the marketing and development strategies may win, rather than the 
standards that ensure the highest level of commonality and consistency needed 
by users. 


KEY IDEA! 


When watching a videotape on their VCR, most people don't 
think about the history behind the videocassette technology. One of the best ex¬ 
amples of marketing winning over technology can be found in the VHS vs. 
BetaMax war for control of the videocassette tape market. Most experts agreed 
that BetaMax technology was superior to VHS videotape technology. However, 
the war for control of the industry was not won by the best technology, it was 
won by the best marketing and political strategy. Most people don't even have a 
clue that the VHS technology was believed to be inferior to BetaMax. 


Apple Computer, Inc. had a head start into the multimedia PC environment. 
The Macintosh computer evolved more easily into the multimedia arena because 
the hardware and software are much more integrally related than the IBM PC 
hardware and software. Also, as noted by Frichtl (1990), "Establishing Macintosh 
as a multimedia platform for the masses is an important goal for Apple Com¬ 
puter. The company is out front with a multimillion-dollar 'Desktop Media' ad¬ 
vertising blitz. Behind the scenes, Apple developers are hard at work hoping to 
make every Mac capable of producing multimedia presentations." 

Earlier I discussed how Apple and IBM jointly created Taligent, a new com¬ 
pany that is working on a future object-oriented operating system. Apple and 
IBM also joined forces in 1991 to create Kaleida Labs, Inc., a company with the 
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mission to develop and promote new multimedia software technologies that span 
the computer, personal electronics, and communications industries. Recently, 
Kaleida announced a potential deal with Japanese consumer electronics giants 
Hitachi and Mitsubishi Electric to include Kaleida software on their multimedia 
devices. Kaleida already has a similar technology alliance with Toshiba Corpora¬ 
tion. 

Microsoft also has been very busy in the multimedia arena. It has developed 
a set of standards called the Multimedia PC (MPC) specifications and has enlisted 
Compaq Computer Corporation, Analog Devices, Inc., and other developers to 
build hardware and software technology that will run on the MPC platform. One 
major area of focus is the use of audio in the work environment. 

In 1993 IBM also announced the formation of Fireworks Partners, a separate 
business unit within the Personal System Division. Fireworks Partners has the 
mission to foster the worldwide development and deployment of advanced mul¬ 
timedia applications and services for the commercial and consumer markets. 

Recently, IBM announced a joint venture with Blockbuster, combining the 
efforts of the world's largest computer company with the world's largest retail 
entertainment company. They have joined forces in a multimedia strategic part¬ 
nership to provide digital entertainment products and services. One of the main 
areas of interest is the just-in-time publishing of audio CDs, audio tapes, games, 
and software distribution. Customers could walk into a multimedia storefront, 
choose a number of songs from any singer or composer, and walk out in a few 
minutes with a personalized CD created on-the-spot. The world's leading record 
companies are not pleased with this strategy and have vowed to obstruct the ef¬ 
fort. I've been discussing the GUI-OOUI war. Now multimedia has joined the 
war. Eater in this chapter I'll show you an example of a multimedia in-store kiosk 
I worked on in a joint IBM-Blockbuster Video project. 


KEY IDEA! 


Multimedia provides the arena for the blending of computer 
technology with the entertainment and television industries. Hollywood has 
been the target of several new ventures involving computer companies. IBM has 
joined with three major Hollywood effects experts to form a company called 
Digital Domain. The company will be a visual effects and digital production 
studio based in Los Angeles. The following quote shows how important user in¬ 
terfaces are in the new world of multimedia. "The principals emphasized that 
they will provide new and friendlier interfaces so directors of traditional films can 
tap the new digital tools, integrating the effects with live-action footage." (Silver- 
stone, 1993). That's an ambitious goal, given the complexity of the world of mul¬ 
timedia and filmmaking, and the current state of computer user interfaces. 
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Will Multimedia Help Users Work Better? 


"With a ground swell of hardware and software finally reaching 
market, corporate users are finding that multimedia is slowly 
the evolving from its cutting-edge niche into the mainstream." 

Erica Schroeder, 1992 


It is easy to list the obvious benefits of multimedia for users. Users now have ac¬ 
cess to more information simultaneously to stimulate their learning processes. 
The information presented to them should also be the most appropriate form of 
information for what they are doing at that moment. Remember Bill Gates’ 
phrase, "information at your fingertips"? Multimedia gets us partway toward this 
goal. 

For example, let's say you are learning how to repair the engine in your car 
and you have a software product that teaches you how to do this. When you first 
work with the program, the information might be in the form of text, graphics, 
and video. However, later when you might be lying under the car, doing a par¬ 
ticular task, you can't see the computer display, so it would be nice to have audio 
instruction to lead you through the steps as you work under the car. Going even 
further, wouldn't it be useful to have the computer program understand voice 
commands, so you could say, "Stop. Back up. Repeat step 3 again," if you wanted 
to hear part of the instructions again? 

The same difficult question I asked earlier for graphical user 
interfaces must also be asked for multimedia: Do the increased hardware, soft¬ 
ware, support, and training costs and resources provide any worthwhile increase 
in user productivity? A survey conducted by WorkGroup Technologies, Inc., re¬ 
ported in PC Week (Schroeder, 1992), asked the basic question, "Does multimedia 
improve productivity?" People were asked to state their level of agreement with 
the statement, "Multimedia improves productivity." Their answers from 208 re¬ 
spondents responsible for coordinating 59,000 PCs were: 

® 12% — Agree 

® 38% -- Somewhat Agree 

• 26% — Somewhat Disagree 
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• 16% -- Disagree 

• 8% — No Answer 

Respondents were also asked, "Do you plan to install multimedia PCs in the 
next 12 months?" Thirty percent responded "Yes" while seventy percent re¬ 
sponded "No". Surveys like this show that most corporations and users aren't 
quite ready to make the necessary hardware and software commitments to move 
to the multimedia platforms. Why? Because multimedia is not quite a mature 
enough technology to fully impact productivity across the range of products on 
the desktop. Specific work areas and specific tasks can be shown to be made 
easier by using well-designed multimedia, but it is too early to give very positive 
answers to general questions like those asked in these surveys. 


The Key to Success: Choose the Right Media 
"The medium is the message." 

Marshall McLuhan, 1964 


KEY IDEA! 


The benefits of multimedia for software developers are many. 
Multimedia widens the range of information presentation and interaction tech¬ 
niques and media available to developers. This can lead to the development of 
wonderful new software programs for users. However, there is one major critical 
issue. Developers should not use multimedia as a shotgun approach to present¬ 
ing information. That is, don't just give users information in all the possible dif¬ 
ferent types of media just because you have the ability to do so in your develop¬ 
ment environment. This is an extreme example of the "Las Vegas" effect with the 
overuse of color. 


When working with multimedia, it is even more important that designers 
and programmers know how people will use the product. The critical factor in 
developing successful multimedia products is to ensure that the information is 
delivered using the correct media. Only one type of information, such as text, 
might be needed for a particular task, or some combination of media might be 
called for. Task analyses must be conducted to determine what the best media are 
for the type of information, for the tasks users are performing, and for the way 
users want to work at that time. For example, if you find out that users don't 
want and don't need animation and video in their work environment, your 
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product should use text, graphics, and audio and shouldn't force users to buy 
animation and video-capable computers to use your software. 

The more difficult question to answer is how do people learn most effec¬ 
tively? Using the car repair education example, is it more efficient for someone to 
watch an expert fix a car engine rather than read step-by-step instructions ac¬ 
companied by graphic illustrations? This is not an easy question to answer and 
the answers will vary for tasks, users, and situations. People have different cog¬ 
nitive styles, or ways of processing information, and optimally any multimedia 
instruction should be customizable by users to match their personal learning 
preferences. Some people would rather watch someone else perform a task, while 
others might prefer to read the step-by-step instructions. 


The Costs of Multimedia 


There are many costs associated with multimedia computing. Multimedia 
hardware may include larger systems, faster processors, additional graphics, au¬ 
dio and video capture and playback cards, high-resolution displays, alternative 
input devices, such as touch screens, pen, voice, and other multimedia peripher¬ 
als such as cameras, videocassette players, laserdisc players, speakers, and so 
forth. Many multimedia computer systems are advertised as "plug and play" 
systems that are multimedia-capable right out of the box. I've found that many 
systems are actually "plug and play and add memory and play and add cards and 
play and add..." 

One of the most critical aspects of multimedia that must be thoroughly un¬ 
derstood by developers and users alike is the amount of storage required to work 
with multimedia data. Here are some general facts about multimedia storage re¬ 
quirements (Pedersen, 1993): 
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One of the most important boosts to multimedia computing was the intro¬ 
duction of CD-ROM as an alternative storage device. Multimedia CD-ROM 
drives were first introduced in 1984. The Optical Publishing Association (OPA) 
estimates that 5 million CD-ROM computer drives will be sold in 1993, twice as 
many as were sold in 1992. With all of the wonderful advantages of multimedia 
technology, we had to wait for the advances in hardware storage devices before 
multimedia became practical. It still is on the early end of practical and afford¬ 
able, but that will improve over time. 


Multimedia and GUIs 


"The No. 1 use for multimedia is training, and the No. 2 use will be 
multimedia mail using audio. Online multimedia help is also going 
to be very important-the demand for that will be really explosive. 

Chris Vanover, 1992 


The overall goal for multimedia used on computers is to enhance the communi¬ 
cation between users and the computer. Multimedia products and interfaces are 
used for training, education, presentations, sales and marketing, arts and enter¬ 
tainment, reading, reference material, and research. Graphical user interfaces al¬ 
low multimedia to fulfil its potential. 

Adding sound to business presentations, memos, and documents is one of 
the fastest growing applications for multimedia. Estimates of sales of add-on PC 
audio boards show a threefold growth from 2-4 million units in 1992 to 6-9 mil¬ 
lion units in 1996. 

In the advertising industry, multimedia has opened a whole new area for 
presenting information and "getting the message across." Companies are now 
sending electronic brochures and financial reports to customers and stockholders. 
Electronic bulletin boards are now targets for companies trying to advertise their 
products. How do you advertise on an electronic bulletin board? With multi- 
media, of course. 

Multimedia has also opened the doors to easy access of information in other 
areas. There are multimedia medical and health books that can show text, illus¬ 
trations, audio clips, and video of any medical or health topic. Electronic maps 


Multimedia: The Future? Or, Just New Technology? 


325 



H _ Program Manager _ H *1 

file Options Window Help 


m 



WIN-OS/2 Accesses* ies 


-3---- 

v | - 


A 

Write 

Paint Brush 

p j 
Calculator 

■ 

Clock 

A 

Sound 

Recorder 

Jp 

Card File 


m 

Calendar 

® 

Object 

Packager 

Character Map 

Note Pad 

n 

Media Player 





«==4 . • ' 

File Device Scale Help 



Corel Graphics 


Applications 


Startup 


Usal 

WJN-OS/2 Mam 


Figure 10-2. Windows 3.1 Multimedia Capabilities* 


and travel guides are also handy for travellers who want to plan their trips from 
their computers before they ever leave their homes. 

GUIs are providing multimedia software capabilities in their operating sys¬ 
tems for both developers and users. Early in 1993, Apple released version 1.6 of 
their QuickTime multimedia architecture software for the System 7 operating 
system on the Macintosh line of computers. They have also moved QuickTime 
onto the Microsoft Windows platform with their QuickTime 1.1 for Windows. 
QuickTime allows the ability to edit multimedia data, such as video, sound, and 
animation, with the same cut, copy, and paste techniques used for other data in 
the user interface. 
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K E Y I D E A ! 


GUIs provide a visual environment for multimedia devel¬ 
opment and presentation, but their basic limitations hamper the user of multi- 
media in a number of ways: 


GUIs are application-oriented, rather than object-oriented, so most de¬ 
velopers and users must first run an application to do anything with 
their multimedia data. 

Current GUI operating systems don't allow complete simultaneous 
processing, so users can't receive the full advantage of multiple sensory 
presentations from multiple sources on the computer. 

GUIs don't typically provide robust direct manipulation techniques, 
which would help when working with multimedia data. 


Apple's competition in the Windows environment comes directly from 
Microsoft. Originally developed as multimedia extensions to Windows 3.0, the 
basic multimedia capabilities are built into Windows 3.1. This includes the Sound 
Recorder and Media player shown in Figure 10-2. Microsoft has also built a 
product called Video for Windows that enhances the basic multimedia capabili¬ 
ties found in Windows 3.1. In addition, Microsoft has also developed a Windows 
Sound System audio board and Modular Windows, a stripped-down version of 
Windows for consumer devices, which I'll discuss in the next chapter. 


Multimedia and OOUIs: A Perfect Match 


Earlier I said that with object-oriented interfaces, things should look like they 
work and work like they look. Multimedia carries this concept even further. 
With multimedia, things should look, move, and sound like they work, and they 
should work like they look, move, and sound! 

Multimedia is a natural extension to OOUIs, as OOUIs provide developers 
and users with features that are key to multimedia development and end-use. To 
summarize these key ideas, OOUIs: 

• Present and interact with multiple objects at the same time. 

® Present multiple views of objects at the same time. 

• Allow direct manipulation of data and objects, rather than via applica¬ 
tions. 

® Shield object media and technology complexities from users. 
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Figure 10-3. OS/ 2 2.1 Multimedia Objects* 


OOUIs have joined the multimedia fray with IBM's Multimedia Presentation 
Manager/2 (MMPM/2) for OS/2. Originally developed as extensions to the 
OS/2 2.0 operating system, the product is now part of the OS/2 2.1 operating 
system. Since OS/2 2.1 includes Windows 3.1, the MMPM/2 system also cur¬ 
rently runs Windows multimedia data. Figure 10-3 shows some of the multime¬ 
dia objects in OS/2 2.1. I'll discuss these objects and their effects on multimedia 
in the user interface in more detail later. 


The Key Interface Aspects of Multimedia 

As the focus of this book is on users and software user interfaces, there are two 
aspects of multimedia that I'd like to discuss with regard to how users interact 
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with multimedia on computers. The first aspect is the issue of multimedia as data 
and objects. The second aspect is the use of multimedia as part of the user inter¬ 
face to better enhance communication between users and their computers. These 
two aspects are by no means exclusive, and in fact both are very important to 
developers and users. 

A book I wrote, titled Guide to Multimedia User Interface Design (IBM, 1992a) 
helps designers learn some of the basic concepts of working with multimedia in 
an object-oriented user interface. This book is part of the technical library for the 
OS/2 MMPM/2 product that was shipped with OS/2 2.1. This work is also 
touched upon in the CUA Object-Oriented Interface Design (IBM, 1992c) in Appen¬ 
dix A: "Applying CUA Concepts to Touch Input and Multimedia User Inter¬ 
faces." There are many technical books and articles on developing multimedia 
products with the different operating systems. An easy-to-understand overview 
on MMPM/2 and OS/2 was published in the IBM OS/2 Developer magazine (Par¬ 
sons and Enright, 1992). IBM's forthcoming interface architecture, CUA 1993, 
plans to integrate multimedia, in particular time-based media, into the base user 
interface guidelines, rather than include them as an added appendix. This mir¬ 
rors the IBM strategy of building multimedia into the operating system and user 
interface, rather than positioning multimedia as an add-on technology. 


Multimedia as Data 


"For years, selling multimedia CD-ROM titles has been jokingly 
described as a 'zero-billion dollar industry.' Struggling developers 
have seen their Herculean efforts greeted with nothing but a trickle 
of orders. But the gallows humor enjoyed by CD-ROM publishers 
may soon be a thing of the past. New marketing figures indicate 
there may finally be a 'there' there: CD-ROM sales are skyrocketing. 

Tony Reveaux, 1993 


As I've just shown, the storage requirements for even small amounts of multime¬ 
dia data can cause headaches for developers and users. This situation even has its 
own name-the mediated problem. Large amounts of data and large data files are 
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not limited to the realm of multimedia, but the problem arises immediately and 
looms large when you are in the multimedia arena. 

Not only is the size of multimedia a problem, but the types of data-either 
text, graphics, animation, audio, or video-have different data formats and differ¬ 
ent input/output access rates. Audio and video are time-based data, which 
means they depend on the accurate representation of time to derive their mean¬ 
ing. A Mozart violin concerto does not have the same meaning if it is played at 
half-speed. So, too, does a video clip lose its meaning when the frame rate is 
varying constantly and it is not synchronized with its audio information. Let's 
look at the interface aspects of multimedia as data. 

Multimedia Objects and Views 

The object-oriented user interface is perfectly suited for multimedia. The older, 
application-oriented interface forced users to use many different applications to 
work with different data types. Integration of these data types into one document 
or presentation was difficult, if not impossible. Object-oriented interfaces focus 
on the objects required to accomplish tasks. If done correctly, it doesn't matter 
what types of objects users work with, they should share all of the common as¬ 
pects of all objects in the interface. 

BBadnBrani Most multimedia objects fall in the general category of data 
objects, as I described in Chapter 6. Text, graphics, image, audio, animation, and 
video are all multimedia data objects. With the concept of higher-level objects, 
such as composite objects, users may mix and match any type of data objects 
within a composite object, such as a document or presentation. Even multimedia 
objects may be composite objects. At the most basic level, a song contains other 
objects, such as the notes in the song. At a more sophisticated level, a symphony 
is a multimedia composite object. One view of the object is the actual audio 
soundtrack for the symphony. Another view might be the musical score for the 
symphony. A biography of the composer might be another view of interest to lis¬ 
teners. The background of the symphony's composition could also be viewed. 
These views may also be dynamically interrelated. As the soundtrack is played, 
the exact position in the musical score is highlighted for users to follow. Figure 
10-4 shows some basic multimedia objects and some views of these objects. 

Each object type has associated with it a number of views, just as the system 
objects have the standard views I discussed in Chapter 8. Settings views are a 
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Figure 1 0-4. Multimedia Data Objects and Views* 


part of all object types. Most media objects will also have some type of player or 
viewer associated with them, as we see today with users associating text objects 
with their favorite word-processing program. Using these player views, users can 
manipulate the media objects in some way. An audio object will have a player 
view that will play any type of audio data, whether it is a MIDI (Musical Instru¬ 
ment Digital Interface) data file, waveform audio, digitized audio, or prerecorded 
audio. Figure 10-4 shows media players for digitized audio objects (the .WAV 
files) and for Compact Disc audio data. Other views should also be available for 
more sophisticated manipulation of the object’s data, such as advanced audio, 
animation, or video editing. The OS/2 MMPM/2 product includes a multimedia 
data converter to help advanced users work with different data formats. 
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As with other objects in the OS/2 interface, users don't have 
to know about the underlying structure of their work objects. This is very impor¬ 
tant for multimedia objects. Users should not have to be concerned with the ac¬ 
tual format of the data or the location of the object. The location of the object and 
data may be somewhere on the computer's hard disk, floppy disk, CD-ROM, 
laserdisc, or any other type of input medium, such as a live microphone, TV sig¬ 
nal, or videocassette system. Users don't care about the location and shouldn't 
have to know about it. 

The computer hardware associated with multimedia can also be represented 
as device objects in the user interface and as such, would have standard views, 
such as settings and contents. For example, a CD-ROM drive will be displayed in 
the Drives folder of OS/2. If the CD disk contains data, a contents view is pre¬ 
sented when the object is opened. In the future, the operating system will detect 
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the presence of other types of data and present the appropriate view. If the CD 
contains audio data, then an audio player would be presented so that users can 
access any track of audio on the disc (Figure 10-4). Allowing users some control to 
customize their CD-Audio listening, users can skip tracks on the CD. This in¬ 
formation is saved and automatically remembered when a particular CD is 
played again. OS/2 also makes working with often complicated multimedia 
hardware easy by providing a setup notebook that automatically contains all of 
the mult im edia devices attached to the computer (Figure 10-5). Customized 
pages can be added for specialized multimedia equipment. Users can easily see 
and change all settings and options for their multimedia devices in one view. 


Interacting with Multimedia Objects 

"Eight years ago, the introduction of QuickDraw allowed Macintosh 
users to easily paste graphics into any text document; desktop 
publishing was born. By the end of this year, Apple intends to 
release QuickTime, an extension to system software that will 
allow users to paste time-based data-video, animation, and 
sound initially into just about any document." 

Lon Poole, 1991 


To me, one of the most interesting aspects of multimedia is the wide range of data 
and object types that users now have to work with on their computers. It has 
been difficult enough for users to work with the more common data types, such 
as text and graphics. One of the keys to success for multimedia is that it must be 
as easy or even easier to work with multimedia data than the way most applications 
have allowed users to work with data in the past. Typically, multimedia was de¬ 
veloped only with very specialized applications within very limited contexts. 
Many products today force users to work with multimedia data as separate ele¬ 
ments, such as audio annotations, rather than as main elements of the product. 
Users today shouldn’t have to learn completely new ways to interact with mul¬ 
timedia data. The same interaction techniques I've discussed for data and objects 
in graphical and object-oriented interfaces must work for multimedia data. 

Figures 10-3 and 10-4 show some multimedia objects and interface controls 
used to work with them. Users should be able to use the same buttons, check 
boxes, lists, settings notebooks, and other interface controls to work with multi- 
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media data in the same ways they used these controls to interact with the data 
they use today. Notice the push buttons for common audio controls, such as play, 
rewind, stop, and pause. A new interface control was specifically developed for 
the OS/2 MMPM/2 product. It is the circular volume control shown in the fig¬ 
ure. Sliders are also fairly new interface controls used to set values, such as vol¬ 
ume, but users, when asked, said they would also like some controls that are 
similar to those on the devices they use everyday, such as radios, tape players, 
and compact disc players. 

The benefits of multimedia can also turn into the nuisances of multimedia. If 
users are playing a long audio or video sequence, they should be able to turn 
down the sound quickly, using a mute button perhaps (see Figure 10-3), and also 
pause or stop the sequence if they are interrupted or wish to stop and back up. 
Also, because of the large amounts of data and large file sizes for multimedia ob¬ 
jects, be sure that users are really sure of what they are doing with their objects. 
For example, don't automatically fill a container object with all the objects users 
request unless they can reasonably be handled with the system's storage and 
within a processing time that is acceptable to users. 

Object-oriented concepts help users organize their large numbers of multi- 
media objects in more work-related ways. The use of folders, workareas, shad¬ 
ows, and associations allows users to organize and manage their objects in many 
different ways. They may want to organize objects in containers by their media 
type, such as audio or video, or by projects that may mix object types. 


KEY IDEA! 


Interactions with objects as a whole should not depend on the 
type of media contained in an object. This is what the object-oriented interface 
brings to multimedia. Objects are objects, regardless of the type of data they con¬ 
tain. Creating, copying, moving, connecting, and deleting objects on the desktop 
should be done with exactly the same techniques for all types of objects and data. 
That is part of the object-oriented design goal of not forcing users to know more 
about the computer system and the information they are working with than they 
need to know. 


The extensive use of direct manipulation in GUIs and OOUIs also lends itself 
to working with multimedia objects. All interface interaction techniques must 
strive to hide the complexities of the underlying media. Technically, user data 
manipulation actions, such as editing, and cut/copy/paste actions may be very 
complex under the PC covers for multimedia data. All direct-manipulation 
techniques should work with different types of objects in similar ways so users 
don't have to learn new interaction techniques for each type of data or object. 
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Tools: If You Can Build It, They Will Come 


Another key to the success of multimedia computing will be 
the availability of easy-to-use tools to build multimedia presentations and to in¬ 
corporate different elements of multimedia into objects people already know how 
to work with, such as documents, memos, mail, graphics, and spreadsheets. And 
the key to any set of tools is the interface to the tools themselves as well as the user 
interface for the data objects. This follows the same trend that we see now with 
object-oriented programs and interfaces-everyone wants to have them, but they 
aren't easy enough to build just yet. I see lots of reviews of multimedia products 
that make the same conclusions: "This multimedia package is no toy. It’s also not 
the kind of program you or one of your employees can learn in an hour. Au- 
thorware Professional is aimed at professional course designers. Until Macro- 
Media gets the price down, it's still not a practical purchase for most Windows 
users-even if it is a great (and fun) program." (Harrel, 1993). 

As with operating systems, multimedia is judged by the number and quality 
of the tools and programs designed to work in that environment. Apple, 
Microsoft, IBM, and others are all working very hard to get tools in the hands of 
developers and users. Apple is constantly improving its main multimedia tool 
kit, QuickTime, on both the Macintosh and Windows platforms. Microsoft is 
pushing its Microsoft Video for Windows as the multimedia standard tool. IBM 
has enlisted a large number of key tool vendors to develop multimedia tools for 
the OS/2 2.1 platform. There are more than 70 tools in IBM's Ultimedia Tools Se¬ 
ries (UTS), lead by the introduction of three new IBM-developed tools: Ultimedia 
Builder/2, Ultimedia Perfect Image/2, and Ultimedia Workplace/2. There's also 
a new product under development, Ultimedia Manager/2, that automatically 
classifies, searches for, identifies, and sorts images by color, texture, shape, layout, 
and text descriptions. These tools can be powerful aids in the fields of photogra¬ 
phy, desktop publishing, education, and medicine, for example. 

Although most of these tools are still designed for the somewhat experi¬ 
enced multimedia developer, they all are supposedly designed to use the same 
user interface concepts and techniques as their underlying GUI and OOUI oper¬ 
ating system environments. This means that users shouldn't have to learn brand 
new object manipulation and interaction techniques for these new tools. 
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Multimedia as Part of the User Interface 


"A human being learns and retains best when looking at a map, 
hearing a sound, watching a moving picture, or choosing a path. 
Multimedia offers exactly this capability." 

Andrew Himes, 1989 


The second way to look at and use multimedia is as part of the user interface. The 
goal is to use multimedia to enhance computer-user interaction in two ways: 
presentation and interaction. Multimedia should not be limited only to being uti¬ 
lized as new types of data for users to work with. Multimedia has already been 
used to enhance the communication between users and computers for many 
years, if only in very simple and unimpressive ways. Every time your computer 
beeps at you when you press a key that doesn't do anything at the time, that's 
multimedia! It's an example of the interface using one form of information, an 
audio sound, to provide feedback and information to users that what they are 
trying to do doesn't work. 

The goal of multimedia in this area should be to enhance the user interface 
and enhance the usability of computer software. It should not be to add sound 
and animation whose only purpose is to contribute to the Las Vegas effect I've 
described for screen colors. Adding gratuitous multimedia enhancements to 
nonintuitive user interfaces is akin to putting lipstick on the bulldog, as I de¬ 
scribed earlier. Adding animation, graphics, video, and sound can add to the al¬ 
ready confusing interface most users face on their computers. 

Multimedia should be looked at as additional ways of using the interface 
design principles to enhance the quality of their interaction with the computer. 
Each of the principles—place users in control, reduce memory load, and make the 
interface consistent—can be strengthened by using multimedia wisely and ap¬ 
propriately. 


Enhancing Presentation 

Object designers can use multimedia to enhance the power of the object-oriented 
interface. They should look to see where multimedia can be used as alternative 
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representations of data and more meaningful views of objects. For example, a car 
dealership program could have many ways of presenting the available options for 
the car. Still photographs or a video segment could show the exterior and interior 
colors available, as well as the different seat upholstery options. An audio clip 
could highlight the sound systems available. A textual list of the available op¬ 
tions probably won't excite customers to purchase the products as much as some 
form of multimedia presentations of colors, patterns, and sounds. These things 
have to be seen and sensed, rather than read about on a description or label. 

Following the car engine repair example I talked about earlier in this chapter, 
information presentation does not have to be limited to only one medium or even 
some combination of two media, like text and graphics. Think of objects that us¬ 
ers work with as generic objects (mail) rather than as a certain type of data (text). 
Mail might be the written words, the spoken voice, or a video of the author of the 
mail. Multimedia has incredible potential to enhance common objects like help, 
tutorials, and other instructional presentation vehicles. 


Enhancing User Interaction 

Some of the most popular PC software utilities are screen savers, icons, anima¬ 
tions, and sound add-ons. Almost all of these products are designed to make the 
computing experience more enjoyable and they don't pretend to be productivity 
enhancers. These products use multimedia in the interface to entertain users and 
alleviate stress in the workplace. In addition to these characteristics, multimedia 
can be used to provide additional meaning and information in the user interface. 
Most people talk and listen more naturally than they read and write. 

Why can't your favorite spreadsheet speak the numbers to you from your 
monthly expense report? This can reduce your eye fatigue from reading on the 
computer screen all day. Why can't your word processor tell you that you are 
writing too many run-on sentences in your presentation script? It should also 
highlight the longest sentences for you to easily find and correct. And finally, 
why can’t your mailbox object start blinking red when there is an urgent note 
from your boss that you had better read right away? 

These are all examples of possible uses of multimedia to en¬ 
hance the way we currently interact with computers. If we can do these things 
with multimedia now, just think of the possibilities in the future! In the next 
chapter. I'll discuss the future technologies and interfaces you can look forward 
to. In the meantime, I hope we can move beyond the fun and entertaining stage 
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of multimedia we currently are in to the time when we have truly useful applica¬ 
tions for multimedia in the user interface. 


Sound: Useful Enhancement or Just Noise? 

It is interesting to note that with the rush to visually-oriented user interfaces, so 
far we have virtually ignored the sensory abilities of humans. Now with the ad¬ 
vanced hardware capabilities, designers are finally "tuning in" to providing users 
with information based on another sensory modality. You use sound every day 
when working with computers, even though you may not realize it. You can hear 
when your PC printer is running, even though it might be around the corner in 
the next office. You can hear your disk drive spinning while it is reading a dis¬ 
kette. Although the printer and computer were not designed to produce sounds 
to provide this information, you use the information present in these sounds as 
feedback and confirmation to make task and work decisions. 

For some reason, sound (or audio, for technical readers) seems to symbolize 
multimedia. I guess this is because audio is not as complex as video. Hardware 
manufacturers add sound capabilities to their systems and then proclaim them to 
be multimedia systems. Spreadsheets and word processors allow users to attach 
voice annotations and then advertise that they are multimedia-enabled. Sound is 
to multimedia as color is to graphics. It is glitzy, fun, and entertaining, but can 
easily be overdone and can drive users to want to turn the sound off as soon as 
they turn their systems on. 

The lesson to learn from color and graphics is not to use sound just to spice 
up the product interface, but to use sound to provide additional meaning, feed¬ 
back, and cues for users at work or play. In many environments and in many 
cultures it is just not appropriate for computers to be beeping and singing all day 
long. I've heard stories of workers in Japan unhooking the internal speakers in 
their PCs because they don't want their managers and co-workers hearing any 
error beeps coming from their work cubicles. Workers will lose face if they make 
too many errors. The last thing they want is their computer telling them they 
made an error. 

Sullivan (1991) writes of users' first experiences with sound on their com¬ 
puters: "A number of users who were learning to use a page layout program on 
the NeXT computer in a local lab experienced a 'startle effect' when the tutorial 
began to talk to them. They jumped, fidgeted, exclaimed, swore, etc. Almost ev¬ 
ery one of them tried to find all the instances of voiced information in the tutorial. 
Most lost track of what they were trying to learn. Many brought their friends to 
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see/hear it. Only the person responsible for report production learned the sys¬ 
tem, and that person did not use the tutorial again." Here we see that not only 
did the use of sound not enhance learning, but it actually impeded learning how 
to use the system. 

With the MMPM/2 multimedia enhancements to OS/2, users can associate 
system events, such as opening and closing windows and dragging objects, with 
digital or prerecorded sound clips. I found them to be entertaining for a short 
while, but my co-worker in the next office asked me to turn off the sounds be¬ 
cause they were bothering him. I haven't yet figured out if they really help in any 
other way than to keep me from falling asleep while working on my computer. 
Figure 10-6 shows the Settings view notebook page for assigning sounds to sys¬ 
tem events in the OS/2 interface. 
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Much research has investigated the use of sound in the computer user inter¬ 
face. Apple designers and researchers designed the SonicFinder , an auditory 
interface for the Macintosh. Gaver (1989) stresses, "Sound should be used in 
computers as it is in the world, where it conveys information about the nature of 
sound-producing events. Such a strategy leads to auditory icons, which are ev¬ 
eryday sounds meant to convey information about computer events by analogy 
with everyday events." This research and the early Apple products are the be¬ 
ginnings of the auditory evolution in PCs that has brought us to the point when 
your computer can sound like Captain James T. Kirk saying, "Beam me up. Scot- 
tie!" 

Gaver points out some interesting aspects of sound and vision that you 
might not have thought of. Visual information requires users to look in the ap¬ 
propriate direction. If something changes visually on the screen and you aren't 
looking, you won't see the change. Sound does not require users to pay direct at¬ 
tention to the source of the information. You don't have to be looking anywhere 
near a telephone to hear it ring. However, visual information can be presented in 
many locations at the same time, allowing users to process large amounts of in¬ 
formation by looking in different directions. Sounds don't work as well with 
multiple signals; our ears don't discriminate as well as our eyes. 

Sounds can provide information in a number of ways. First and most com¬ 
mon, sound can be used to provide confirmation and feedback for user and sys¬ 
tem actions. Second, sound can provide information about ongoing processes 
and the status of objects and the system. Third, sound can be used as an aid in 
navigating through a system; and fourth, it can be used to help users organize 
and identify information. 


KEY IDEA! 


The well-designed use of sound in the user interface can also 
help users who have visual impairments, physical disabilities, or other special 
needs. A new federal law forces employers to provide handicapped workers the 
proper equipment for them to do the same work as any other employee. A 
friend's mother has recently lost most of her sight and is now using the IBM 
Screen Reader product to work on her computer. 


These products even work with today's graphical and windowed user inter¬ 
faces. I remember once explaining all of the wonderful visual elements of 
graphical user interfaces to a class of students. One student in the front row 
suddenly said, "How am I supposed to use these new interfaces? I'm blind!" This 
stumped me for a minute, but then I was able to convince the student that a 
well-designed graphical user interface should make it easy for special-needs 
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products like Screen Reader to translate the graphic elements on the screen into 
meaningful verbal information. Multimedia provides many new ways to present 
information to users who have limited use of some of their sensory channels. 
Again, this area is not new and much research has been conducted with the goal 
of providing access to computers and information for all people regardless of 
their physical capabilities. An early research article titled, "Soundtrack: An Au¬ 
ditory Interface for Blind Users" (Edwards, 1989), may be of interest to readers. 

Some simple guidelines for using sound in an interface include: Limit your 
use of sound (it can be annoying), use low-frequency sounds (high-pitched 
sounds are even more annoying), and make sure that users can quickly and easily 
control the volume for both a particular situation and for the system as a whole. 
The OS/2 multimedia interface provides both a system volume control and indi¬ 
vidual player volume controls (see Figure 10-6). 


Animation 

"Put the motion in the icon and shake it all up. 

Windows Magazine, 1993 


Animation, like sound, is catching the interest of developers and users alike. To¬ 
day there are dozens of products that give users hundreds or even thousands of 
icons for your Windows and OS/2 applications and objects. Many of these 
products let users animate icons and mouse pointers. As you probably know, 
when you move the mouse over different areas of the screen, your mouse pointer 
may change to show you the types of actions you can perform with that object or 
area of the screen. There are numerous types of mouse-pointer icons (arrow, wait, 
i-beam, do not, and so on). These products provide new still and animated 
graphics for each of these icon types. I've even seen one animation utility that 
makes the regular mouse-pointer arrow wag its tail as it moves across the screen. 

As with sound, much of the value of animation is purely for entertainment, 
although animated cursors may make it easier to see the cursor on the screen, es¬ 
pecially with small, low-resolution screens on many portable and notebook 
computers. Also, low-resolution screens allow only crude levels of animation. 

Animation can be used to enhance the visual information presented to users. 
As I discussed earlier, visual information is only effective if users can actually see 
it. Animation is a change in the visual appearance of a graphic element over time. 
Again, the Apple Macintosh was one of the first popular interface environments 
to utilize animation. Mac users can describe how the Macintosh trashcan bulges 
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Figure 10-7. Customizing System Animation in OS /2 2.1* 


when they drop an object in it. Most of today's graphical user interfaces utilize at 
least a minimal set of animation techniques to show actions, progress, and status 
of user-initiated or system processes. These animations include zooming and 
shrinking windows as they open and close, using an hourglass or watch icon to 
show the progress of short processes and using progress indicators to show 
progress of longer processes. Another familiar form of animation is found in 
Windows and OS/2 with the Solitaire card game. 

Animation is also used in more serious applications. Patricia Sullivan (1991) 
noted, "When the National Science Foundation funded EXPRES, a project that 
developed methods for multimedia electronic document submission, interviews 
revealed that scientists wanted animation for the document so that they could 
demonstrate reactions inside the electronic text." 
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Figure 10-8. Visual Feedback, Status, and Animation in an Installation Window* 


As with all visual and auditory effects, users should be able to turn anima¬ 
tion on and off according to their personal preferences. OS/2 allows users to do 
this at the system level (see Figure 10-7). Users have the option to turn the card 
animation on or off for the Solitaire game. An example of a visually pleasing and 
informative progress indicator is shown in Figure 10-8, which shows the installa¬ 
tion dialog for the MMPM/2 product for OS/2. Notice that the window gives 
users feedback in three ways: the names and path of the files being installed, the 
disk that is being read (Disk 1 or 2), and the progress of the installation process. 

With graphical and object-oriented interfaces, users are usually faced with 
many more icons on the screen than they normally use. Icons, if they are 
well-designed, do provide some information about what an object is and what it 
does. Animation can be used to highlight important icons, to show the status of a 
particular object, or even to explain the behavior of an object. For example, a 
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printer icon should be able to show users that the printer is out of paper and 
needs assistance. An in- or out-basket should give users an idea of the number of 
items in their mail and their urgency. In an earlier prototype of the OS/2 inter¬ 
face, we were able to display a count of the contents of each container on the 
screen, so users didn't have to open a folder or workarea to find out how many 
objects were in it. Although it isn't standard for the OS/2 containers, developers 
can add this type of dynamic animation to any class of container objects. 


Video 

"Desktop Video is the word processor of the MTV generation ." 

Elliot Soloway, 1991 

Video is being used more and more as a new type of presentation medium in the 
computer user interface. Current and future video capture, compression, storage, 
and playback technology have made possible the realistic use of video even on 
personal computers. However, as graphics technology improves, all of the inter¬ 
action techniques I've discussed using animation may be possible using live, re¬ 
corded, or digitized video to enhance the intuitiveness and meaning of interface 
actions and processes. 

I'll discuss video more in the next chapter on technology and future inter¬ 
faces as you'll see the tremendous amount of interest in bringing video into the 
homes of millions of paying consumers. You won’t believe just how much atten¬ 
tion is being focused on this area. 


How Multimedia Affects Your Life 


"Multimedia is a word that strikes both hope and fear in the minds 
of those of us who teach or train others. And with good reason. 

The use of color, graphics, animation, and sound offers some 
exciting alternatives to the static nature of written presentations. 
Restraining this excitement is the fear that the technology, while 
holding promise, is too complicated to learn ." 

Hank Kliewer, 1993 
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These sentiments echo throughout the educational systems around the world. 
Everyone can see the potential benefits for student learning and growth through 
electronic information access and multimedia. For example, IBM's Eduquest di¬ 
vision providing desktop education recently announced that it will work with 
Time Warner Interactive Group to develop a DOS CD-ROM interactive disc 
chronicle of the Berlin Wall crisis of 1961, entitled "Seven Days in August." 
Projects like this will provide students with the ability to participate vicariously 
in historic events rather than merely read about them in a textbook or view a 
stand-alone documentary film. 

Texas has become the first state in the United States to enact legislation al¬ 
lowing videodisc-based materials to be used in place of traditional textbooks in 
the classroom. Educators are realizing that this type of an interface to information 
is much more accessible than using out-of-date text books that students will not, 
do not, and sometimes can not read. 

Now with the additional impact of multimedia technology, there is both 
good news and bad news for education. The good news is multimedia provides 
the potential for enhanced modes of education. The bad news is only 10 percent 
of U.S. public schools offer some form of computer-aided instruction, and the 
percentage of children with regular access to the equipment is much smaller. 
Computer equipment is often purchased by school districts with too little thought 
as to how they will be integrated into the educational curriculum. Computer 
equipment is costly and multimedia devices, such as laserdiscs and CD-ROM 
players are even more difficult to justify for shrinking school budgets. 

We have made some progress in getting computers in front of children in our 
schools, but it isn't enough. Soloway asks the question, "How will we really know 
that information technology has finally made a major impact in the classroom? 
When school lunch boxes come with a CD/computer pouch as standard equip¬ 
ment." 

Multimedia should not be viewed as a complete solution for all education or 
training problems. Multimedia will never replace the human instructor: "There 
is no substitute for the experience and responsiveness to human needs you get 
from a teacher. A human can read body language and other nonverbal elements 
to help improve the education experience." (Tynan, 1993). 


KEY IDEA! 


The interface aspects of the computer's move into the educa¬ 
tion arena are very important and can be discussed at great length. Everything I 
have discussed in this chapter points to the fact that multimedia can greatly en¬ 
hance learning and training if designed properly. If designed poorly, it can actu¬ 
ally retard or inhibit learning. The main issues are the usability of program inter- 
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faces for a wide range of students and teachers and the lack of consistency 
between programs on different platforms (Apple, DOS, and Windows, specifi¬ 
cally). There's also an additional interface concern. While students are intro¬ 
duced to computers at a very young age, especially with the proliferation of video 
games, many teachers do not feel as comfortable about computers and their abil¬ 
ity to use them. Children of the "Nintendo generation" have no fears of comput¬ 
ers and eagerly embrace new technology. Many adults don’t feel the same way. 
Elliot Soloway (1991), in an article titled, "How the Nintendo Generation Learns," 
notes, "Who they are is not who we are. And a key part of who they are is tech¬ 
nology: the Nintendo Generation: TV, video, computer games, walkmen, and 
mounds and mounds of batteries.” 


Multimedia and Literature 

"Electronic books can have color, animation, sound, rapid access, 
compactness, rapid traversal and search, user annotation, electronic 
dissemination and updating, dynamic text to reflect the user's needs, 
and other features yet undreamed of." 

Ben Shneiderman, 1993 


"Multimedia will hasten the end of literacy. Despite the fact that its 
promoters are almost universally well-intentioned , multimedia's 
lasting legacy will be the debasement of the remaining forms of 
communication in this country that have not already been 
debased by the perpetually widening gyre of television." 

Steven Levy, 1990 


Does multimedia enhance literature as we have known it in printed form or does 
it take something away from reading the printed word? It depends on whom you 
talk to. Book publishers are very concerned about the move toward online in¬ 
formation and books on CD-ROM. Can MTV and video games ever really replace 
curling up on the sofa with a good book? 

By the definitions we've explored in this book, the user inter¬ 
face is where and how users interact with their data. With the written book, the 
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interface is the words on the printed page. This interface is well-defined for both 
the author and the reader. The author creates his or her material with the reader 
and the interface in mind. There is a writer's model and a reader’s model, similar 
to the designer's and user's models I've discussed earlier. The writer's goals are to 
put his or her thoughts, ideas, and stories in words so that the reader can take 
those words and recreate the author's world in their own mind. Reading text on a 
computer in a book-like fashion is not very exciting and does not utilize the 
power of the computer and the interface. Perhaps the question should not be 
"Will multimedia replace books?" but, rather, "What new forms of literature will 
become possible with multimedia?" 

Interactive fiction is one of the possible new forms of computer-enabled lit¬ 
erature. Interactive multimedia basically assumes users are more than merely ob¬ 
servers, they are part of the communication process. Readers can branch to al¬ 
ternative plot lines and switch between different storytellers who give their own 
versions of the story in their own voice. Rather than transforming existing writ¬ 
ten novels for the computer, many authors are creating titles specifically for this 
new literary genre. Read about it in NewMedia magazine (Stansberry, 1993). 

The move from linear, written text to hypertext multimedia reminds me in 
some ways of the transition from procedurally-oriented, menu-driven software 
programs to the new object-oriented programming and interface environment. 
With both literature and software programs, the discussions should not be de¬ 
bates over which is better, but which interface is the best for users and their par¬ 
ticular goals. Users will benefit, I hope, from the efforts in moving literary and 
cultural works onto multimedia platforms. 

One way to tell that multimedia has become an established literary medium 
is by the appearance of fringe products that force new interpretations of existing 
moral issues such as sex and censorship. NewMedia magazine bravely discussed 
these issues in their April 1993 issue cover story "Digital Sex: Technology, Law, 
and Censorship." Anew term, dildonics, has become familiar for computer-based 
erotica. Computer software and multimedia magazines are filled with adver¬ 
tisements for adult-oriented CD-ROM materials. One popular program. Virtual 
Valerie, has sold about 25,000 copies a year, totalling about 100,000 copies alto¬ 
gether. The basic question that this new use of multimedia raises is "Does the first 
amendment cover interactive media?" I'm sure there are some interface issues 
here somewhere, but I won't get into them here. 
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Walk-Up-And-Use Multimedia 

"User interfaces for public systems require special care because 
the user group is very mixed. Everybody is a potential user 
and basically no training is possible ." 

D. Felix, 1991 

The kiosk, or public information system, has the potential for the most wide¬ 
spread benefit for multimedia computing for use by a general audience. How¬ 
ever, because of the potential audience, and the lack of control system designers 
and developers have over who uses the system and how they use it, kiosk inter¬ 
faces can be extremely difficult to design. The designer's motto, "Know thy users 
for they are not you," is stretched to the limits when designing kiosks. You see 
computer kiosks in airports, rental car agencies, stores, banks, shopping centers, 
and hotels. 

Kiosks are an appropriate system wherever people need information, wish to 
purchase products, or need to request or perform services. Its uses are in sales, 
service, marketing, public information, and many other environments. Most of us 
are familiar with the older, less-sophisticated kiosk systems we know as auto¬ 
mated teller machines, or ATMs. Like the evolution of software and hardware 
interfaces, kiosks have evolved from primarily keyboard and function key inter¬ 
action to touch, pen, and even voice technology. I don't know of many users who 
believe that the ATM keyboard interface couldn't use some improvements. En¬ 
hancements to the standard teller machines are on their way. NCR has an¬ 
nounced that they are developing ATMs equipped with two-way audio/video 
capabilities designed to allow bank customers at remote terminal locations to 
videoconfer with bank employees. 

Here's an example of the kiosk interface in the sports world. In 1991, IBM, in 
conjunction with the Association of Tennis Professionals (ATP), introduced a 
kiosk information system called PlayerFacts. The kiosk features touch screens on 
PS/2 systems with an iconic interface. Spectators at ATP tennis tourrfements can 
touch one icon and view full-color motion and sound video biographies of key 
players in the tournament. Another icon allows fans to compare player records 
against each other by selecting players from lists on the screen. The head-to-head 
comparison will list a color photograph of each player, the tournaments in which 
the two players met, the type of court surface, and the match scores. The under¬ 
lying data for the kiosk information comes from the IBM/ATP Tour MatchFacts 
global information system that tracks over ten categories of statistics from 3,000 
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matches played by 700 ranked players annually at 77 tennis tournaments 
worldwide. 

Following the release of PlayerFacts, IBM and Wimbledon designed the In¬ 
quiry Tennis Information Service for use at the 1993 Wimbledon championships. 
Originally designed to provide commentators instant access to tennis statistics 
and historical information, it was extended to public use in 1993. I'm sure the in¬ 
terface was redesigned so that the thousands of spectators, at Wimbledon could 
easily and quickly use the interface to retrieve information from the multimedia 
system on television coverage, current match scores, match schedules, and player 
profiles. These are typical examples of the use of distributed multimedia com¬ 
puting using advanced multimedia technology and user interfaces to provide en¬ 
tertainment and information to a large and non-computer oriented population. 


KEY IDEA! 


The key philosophy behind public systems is that the inter¬ 
face must be "Walk-Up-and-Use". Users must be able to accomplish their task 
(whatever it might be) with no learning required, no errors made, and 100% satis¬ 
faction when they walk away. It is difficult to design an interface that is com¬ 
pletely intuitive and foolproof, yet is capable of providing the set of tasks users 
want to perform. 


Felix, Graf, and Krueger (1991) studied the effects of two different methods 
of interaction with a railroad ticket vending kiosk: a step-by-step interface and a 
free-choice interface. Most people preferred the step-by-step interface, although 
people with a higher level of education thought the free-choice interface was 
faster. Most importantly the biggest problem for almost everyone was trying to 
figure out the first step to do, especially in the less-structured interface. 

This study points out the difficulties in designing interfaces for kiosk prod¬ 
ucts. If the audience has little or no computer experience and they must be able 
to complete their tasks successfully, a highly structured, system-directed interface 
is very appropriate. However, casual users or experienced users will want to ex¬ 
plore the interface and don't necessarily want to follow a system-specified path. 
How can designers provide for both these types of users? One of the most im¬ 
portant aspects of the kiosk interface is the initial appeal and its ability to entice 
people to step up and try the interface. The interfaces of today and tomorrow 
have gone beyond the user-friendliness I've talked about throughout this book and 
have moved into the realm of user-seductiveness. 

Current kiosks are beginning to incorporate the benefits of multimedia I've 
discussed earlier in this chapter. The timely presentation of multimedia informa¬ 
tion is critical in kiosk interfaces. Customers will not be satisfied with text-only 
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information presentation or slow, crude graphics and animation. The user inter¬ 
action techniques are also critical to the success of a kiosk interface. The touch 
screen is one of the most natural and comfortable interaction techniques today 
and the goal should be to make interface interaction even simpler and more 
natural. I'll discuss new technologies such as pen, gesture, and voice input in the 
next chapter. 


A Multimedia Kiosk Interface 

In 1991 and 1992, I worked on an exciting development project undertaken by 
IBM and Blockbuster Entertainment Corporation. We designed a touch-screen PC 
kiosk that was developed by IBM in Boca Raton, Florida and was tested in a local 
Blockbuster Video store. I was part of the user interface design team for the 
project. The goals of the kiosk were to offer customers the ability to do three main 
tasks: preview videos of over 1,000 movies in the store, find any information 
about a movie, and get lists of recommended and similar movies. 

The original interface design was a very hierarchical, menu-oriented struc¬ 
ture, with a main menu branching to the three main task menus. However, once 
in any one task, overlapping functions were available and navigation between 
functions and the levels of menus was very confusing. There was also no overall 
metaphor or theme for the interface that allowed users to mentally piece together 
the three main tasks. 

At the time this development work occurred, the CUA 1991 user interface 
architecture had just been published and I was consulting and educating design¬ 
ers and programmers on the OOUI style you now know well. I convinced the in¬ 
terface design team that the interface needed an object-oriented style and a 
real-world metaphor that would allow users to pull all the pieces of the product 
together. The notebook metaphor and interface style seemed to fit well with the 
nature of the environment in which customers would use the product. We began 
to work in the framework and mindset of the Movie Information Guide rather 
than the Video Search, Video Recommendation, and Video Preview menu- 
oriented structure. This didn't mean that all of the existing menus and screens 
had to be scrapped, rather they were modified to fit in the notebook metaphor. 

The movie information guide concept gave users a set of three notebooks 
that they could switch between at any time. The notebooks were named Movie 
Previews, Movie Information Search, and Movie Picks. We prototyped the in¬ 
terface and did some early usability testing before the final program code was 
written. Let's take a closer look at the design of the interface. 
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Movie Information Guide 


Movie Previews 

See exciting previews of over 1,000 movies 


Movie Information Search 


Search for information about movies within 
our database of all movie film titles 


Movie Picks 

Search for movies by choosing the actors, 
directors, subjects, ratings, or critics choices 
that interest you 


Touch any item to get started 


FIGURE 10-9. Movie Information Guide Interface 


Figure 10-9 shows the first screen of the kiosk interface. The screen was ba¬ 
sically divided into three areas. The area along the left side of the screen was re¬ 
served for icons representing the three notebooks along with Quit and Help push 
buttons. The large area in the center of the screen was reserved for the pages of 
the notebooks. This area would contain any instructions, text, graphics, and in¬ 
terface controls for any particular page or screen. This is just how a notebook 
page in OS/2 is designed. The contents of any page are the same as what can be 
presented in any open window or dialog. Notebook tabs would show up the 
right side of the screen if the guide contained more than one major section. Fig¬ 
ure 10-10 shows a guide with section tabs. 

The basic screen layout and design included defining graphic elements 
needed to make the notebook recognizable as a real notebook, and defining the 
colors, fonts, sizes of buttons, lists, other controls, and touch-screen interaction 
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FIGURE 1 0 - 10 . Movie Guide with Section Tabs 


techniques. We even had to make sure we would have room for an on-screen 
touchpad keyboard on certain pages for customers to type the name of a movie. 
Each keyboard key had to be big enough for people's fingers to type letters with¬ 
out making touch-typing errors. Customers get very frustrated if the interface 
touchable areas are too small for their fingers. There are guidelines available for 
designing touch interfaces that address concerns such as the size and location of 
buttons, hot-spots on the screens, and how users will interact with controls such 
as push buttons and radio buttons, as well as scrolling and selecting information 
in lists. All of these areas are critical design considerations for the user interface 
design team. 

While I'm talking about the interface design team, let me describe the team 
we put together. As I discussed earlier, interface design is best accomplished 
when a complementary group of skills are available. Our team included an in- 
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terface designer (me), a graphics designer, a programmer, and a video store man¬ 
ager (subject matter expert). This small group of four people was able to design a 
simple, walk-up-and-use kiosk interface for the video store environment. Our 
two rounds of usability testing showed only minor interface problems and we 
went on to complete the prototype and install the systems in a store in Florida. 

You'll notice that the kiosk interface isn't particularly elegant in these pic¬ 
tures. There are two good reasons for this. First, these screens show the proto¬ 
type for the interface, not the final product. Second, the intent was to product a 
simple, uncluttered interface that anyone could walk up to, use, and enjoy. 


Where Is Multimedia Going? 


Multimedia in the Corporate World 

Multimedia needs to fill defined requirements in the corporate world before it 
becomes useful. Most companies don't want everyone's PC speaking to them and 
making noises all day. I mentioned earlier that many employers removed the 
games that come with the PC operating systems from employee’s computers. I 
remember using The Playroom on a friend's PC at work and I left it running, yet 
hid the window, while I went back to my office to do some other work. Well, my 
friend came back to his office and sat down to work on his machine and started 
hearing random chirps, squeaks, and voices coming out of his PC. He had no 
idea what was going on! 

In the corporate world, the latest buzzword isn't just multi- 
media, it is distributed multimedia. There are major storage demands for multi- 
media on. a stand alone workstation, but those demands expand rapidly when 
you attempt to deliver multimedia across a large organization of people and 
computers. Large mainframe computers may not be dead; they may turn into 
multimedia servers. In November 1992, IBM published a strategy paper for dis¬ 
tributed multimedia computing (IBM, 1992). IBM said its customers want to use 
multimedia as a core communications vehicle within extended businesses rather 
than as just isolated applications on specific workstations. 

Part of the direction paper addresses the need to follow guidelines such as 
CUA's object-oriented interface in designing multimedia products. As I've dis- 
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cussed earlier in this chapter, CUA will be incorporating more and more multi- 
media interface aspects into the base CUA guidelines as they evolve. One of the 
key aspects of interface design for distributed multimedia environments will be to 
ensure that users are kept shielded from the complexities and mechanics of the 
underlying distributed computing environment. Users shouldn't have to know 
where or how a multimedia presentation is stored for them to use the interface. 


Will Multimedia Fulfill Its Promises? 


Multimedia computing is slowly winning the interest of computer users. How¬ 
ever, the potential of multimedia has not yet been tapped, partly because design¬ 
ers and developers really don't know very much about the perceptual and cogni¬ 
tive aspects of users. The focus of this book has been to enlighten readers that 
what is going on at the user interface is much more than the look and feel of icons 
on the screen. 


K E Y I D E A ! 


Cognitive psychologists don't fully understand the amazing 
workings of the human brain, even when we are just doing simple tasks such as 
reading text. To justify the benefits of multimedia, we assume that the brain pro¬ 
cesses information more thoroughly when all of the sensory systems are stimu¬ 
lated simultaneously. That may be true if all of the different information is inter¬ 
related and communicates meaning to users. However, if information is 
poorly-designed and inappropriate, it can lose all the meaning it may be attempt¬ 
ing to convey. Sometimes there isn't much difference between a well-rehearsed 
orchestra playing a beautiful symphony and a bunch of people sitting around 
playing their own instruments. 


Designers should investigate how multimedia technology can enhance both 
the presentation and interaction aspects of their product interfaces. Then, as they 
integrate multimedia techniques into the interface they must pay even more at¬ 
tention to their users and the basic principles for interface design. Nielsen (1990) 
summed it up well: "Modern interaction techniques only increase the need for 
the designer to pay attention to the usability principles since these techniques in¬ 
crease the degree of freedom in the interface design by an order of magnitude. 
There are only so many ways to ruin a design with 12 function keys and 24 lines 
of 80 characters, but a 19-inch bitmapped display with stereophonic sound can be 
an abyss of confusion for the user.” 
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Multimedia is a very complex computing environment and even more care 
must be taken in designing multimedia interfaces. People use computers to work 
with information in ways they couldn’t necessarily work with by other means. 
Users have three basic goals. They try to find information, use information, and 
remember information. Multimedia can be used to enhance all of these areas. De¬ 
signers’ goals must be to ensure that users have the most appropriate information 
available in the most appropriate medium at the most appropriate time for the 
tasks users perform. If this is done, then multimedia will fulfill its ultimate po¬ 
tential. 
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New Technologies: 

User Interfaces of the Future 


"Any sufficiently advanced 
technology is indistinguishable from 
magic." 


Arthur C. Clarke 



What's New for Computer Interfaces? 


"No one leaves a footprint on the sands of time by sitting down. 

Chris Grisonich 


Computer hardware and software technology has improved tremendously over 
the past few years. Computers are finding their ways into more offices, homes, 
and other places around the world. However, most computers in the home are 
still being used for business types of tasks. Why haven't we seen a proliferation 
of computers in the home as the so-called information appliances I've talked 
about? The truth is that even though computers have become very sophisticated 
and extremely cheap, computer products themselves, and especially their user 
interfaces, have not yet become easy enough for people to use in the home for 
everyday simple tasks. Designers and programmers still have not been able to 
figure out just exactly what people want to do with computers in the home, and 
how easy they must be to use before people will actually spend their hard-earned 
money for them and use them. 


KEY I D E A ! 


Today's corporate executives are not as easily impressed by 
new computer technology. Peter Lewis (1993a) notes that corporate executives 
appear to be more knowledgeable about computer technology than ever before. 
They have become more demanding of new technology and less forgiving of the 
inadequacies of current implementations of technology. While they believe in us¬ 
ing new technologies to gain a competitive advantage, they say they haven't been 
getting their money's worth. Designers, programmers, and users should better 
understand their role in the computer-human interaction and should help im¬ 
prove the interface so that any technology, new or old, can be effectively utilized 
by computer users. 


Computers have finally had a serious impact on the way we do our work. 
At first, as with any shift in major technology, computers actually decreased effi¬ 
ciency in the workplace, especially in the service sector. As I pointed out earlier, 
the costs of hardware, software, and training often surpassed any potential ben¬ 
efits of computerization. Now it looks like increases in productivity are realisti¬ 
cally possible with computer technology available today and should improve 
with the technology of tomorrow. 
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This chapter will concentrate on emerging and future interfaces and software 
technologies. In the past, there were much clearer distinctions between work and 
play, office and home, and mainframe and personal computing. It was much 
easier for software developers to target their products to the most appropriate 
audience. There were separate market environments and business areas, and dif¬ 
ferent products for users doing different tasks in different environments. Even 
the entertainment industry was fairly segmented into passive media (television 
and movies) and interactive media (laserdisc and CD-ROM material, and video 
games such as Nintendo, Game Boy, and Sega). 

Today and into the future, users want to be able to do all their tasks- 
personal, entertainment, or work-from wherever they are, be it at home, in the 
office, working in the field, in the car, the plane, the boat, on vacation, or wher¬ 
ever. There will not be any clear-cut distinction between entertainment and work, 
personal and business tasks. You will see a gradual melding of computers, video 
games, entertainment, and television into an integrated set of easy-to-use con¬ 
sumer appliances with simple and intuitive user interfaces. It won't be an easy 
task to build these interfaces, but it sure should be fun! 


Future Computing: Home, Mobile, and Workgroup 


"Power to the people. That's the promise of the new generation of 
devices for mobile computing-what users have been striving for 
since the days of the clean-room mainframe. Mobile devices give 
users-even those with the skills of Maxwell Smart-computer power 
without being tethered to a desk. It's an idea whose time has come." 

Laura Brennan Smith, 1993 


The social and cultural aspects of work environments directly impact how, where, 
and why people use computers. All of these features of computing reflect on the 
user interfaces people must work with. The essential goal of designing interfaces 
for users is getting more difficult because people are now using computers in 
many new ways, in many new places, and for many new reasons. The good news 
is that the technologies necessary to provide user interfaces in this environment 
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are available. The question is, how well can interface designers build the right 
interface for users in whatever situations they find themselves. 

Home Computing 

Many companies now offer employees the opportunity to work at home and 
"telecommute" to work. While many people enjoy this environment already and 
many more look forward to this opportunity, the feeling is not unanimous. For 
example, Apple Computer Inc. recently announced a pilot work-at-home pro¬ 
gram. Less than half the number of people expected actually signed up for the 
program. Apple managers had feared that everyone would sign up for the pro¬ 
gram, but many workers just don't want to work at home, or they need the social 



"You've been telecommuting for a year now, time to lose the tie." 
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atmosphere at work. Many people don't feel that they are doing their job unless 
they show up at the office. Some people felt that the home was more stressful, 
with children, noise, and cramped spaces. 

When designing user interfaces, task analyses must include knowing who 
users are, where they are, and what they are doing. In the past, typical computer 
users could be classified into major categories such as office workers, knowledge 
workers, production workers, and so on. Today those classifications aren't so 
easy to make with computing audiences. 


Mobile Computing 

"Taken as a whole , the mobile computing revolution 
is more important to this country and the world than 
was building the railroads in the 19th century." 

Jonathan Seybold, 1993 


A study (Little, 1990) sponsored by Toshiba American Information Systems, Inc. 
addressed the question, "In what ways (if any) are high-end portable computers 
more effective productivity tools than desktop personal computers?" Their re¬ 
sults show that portable PC users are convinced their systems are superior to 
desktop PCs. Eighty percent of the portable computer users surveyed believed 
that their portable systems enabled them to be at least 5% more productive and 
over half said that they were at least 25% more productive than if they used 
desktop PCs. Almost all (98%) of the participants credited the flexibility and 
freedom their portable PCs provided for gains in efficiency and effectiveness. I 
can certainly understand their beliefs. It would have been much more difficult to 
write this book if I did not have access to a portable PC. In fact, this book was 
written using three computer systems; one desktop PC at the office, one at home, 
and one notebook PC I used while travelling for work. 

Somewhat contradictory to the huge increase of portable PCs now being 
used by workers is the latest concern by the airline industry. Most of the major 
airlines have banned the use of laptop computers, CD-players, and other elec¬ 
tronic devices during takeoffs and landings. There is concern that these devices 
can interfere with flight equipment in the airplane cockpit. This is causing a huge 
debate in the computer industry, as the number of portable computers is esti¬ 
mated to be doubling every four years. In 1989, about 4 million portables were in 
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use. It is estimated that number will exceed 7 million by 1993 and could reach 12 
million by 1996 (Smith, 1993). 


User Interfaces for Mobile Users 

User interface concerns are slightly different for mobile computer users. Many of 
these concerns are ergonomic, due to often cramped and less than optimal work¬ 
ing conditions on the road. Both computer hardware and software really need to 
be customizable for "road warriors"; those of us who are constantly working on 
PCs in airplanes, airports, cars, and hotel rooms. For example, a mouse doesn't 
work very well when you have your notebook computer on your airplane tray 
table and there's no place to use your mouse. Some notebook computer screens 
aren't readable under poor lighting conditions. PC batteries don't last very long. 
Portable computer manufacturers are now moving quickly to provide systems 
that have really been designed for the mobile environment. However, that was 
not the case for early portable PCs. Manufacturers felt they were doing their job 
by simply providing a smaller and lighter version of desktop PCs. Now they are 
finally realizing that mobile computing is really very ergonomically different 
from desktop computing. New portable computers have built-in mouse re¬ 
placements such as a trackball or other pointing devices such as IBM's TrackPoint 
II, a small control stick integrated into the keyboard. Portable PC displays are 
getting larger (over 10-inch displays in some cases), with better resolution, 
brightness, and color. 

Most software interface concerns for mobile computing have 
to do with users being able to customize the operating system and program in¬ 
terfaces for whatever situation they happen to be in. For example, since a mouse 
doesn't work well in the limited space on an airplane, users should be able to do 
all of their tasks from the keyboard. However, depending on the operating sys¬ 
tem and programs they are using, they may or may not be able to do their work 
totally from the keyboard. This is the kind of situation IBM had in mind when 
the CUA guidelines were developed. All CUA products, including the OS/2 in¬ 
terface, should allow users to perform all tasks using either the keyboard or the 
mouse. Also, don't make the keyboard interface so obscure that users can't figure 
it out. That one's a killer when you are on the road! 

I remember one situation a few years ago where I needed to modify a mul¬ 
timedia presentation while I was at another IBM location. I had brought my 
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program disks and my presentation files with me so all I needed was to borrow 
someone's PC for a few minutes. The only system I could find didn't have a 
mouse. No problem, I thought. I loaded the program, opened up my presenta¬ 
tion file, and then couldn't figure out how to access the pull-down menus from 
the menu bar. The standard CUA-defined keys to access the menu bar did not 
work and I tried every function key and key combination sequence I could think 
of to get to the menu bar. Well, then I decided to look up the keystrokes in the 
online help information. No luck there, I couldn't find any listing of the keystroke 
actions. Finally, I searched for the hardcopy product documentation, but couldn't 
find anyone who had the program. Eventually, I had to call a colleague back in 
my office in Austin and had him find the user's guide in my office and look up 
how to navigate to the menu bar pull-downs using the keyboard. It turned out 
that I had to press the number 1 to get to the first pull-down menu, press 2 to get 
to the second pull-down, and so on. This keyboard technique was not the ac¬ 
cepted standard keyboard technique and I never would have figured it out on my 
own without the product documentation. 

In this scenario, if the product designers had followed any of the PC guide¬ 
lines, such as the CUA or Windows guidelines, regarding keyboard access and 
menus, this situation would never have happened. Unfortunately, this happens 
all of the time to computer users, and it is not acceptable! 

When working in a mobile situation, users may want to work with only one 
object or one program at that time. Allow users to be able to run only one pro¬ 
gram at a time or allow users to maximize the program window so that they can 
utilize the entire screen for the one task they are working on. 

Keep in mind the major interface design principles from Chapter 3: 

• Place users in control 

• Reduce users' memory load 

• Make the interface consistent 

These are general principles, but applied to a given product, to a set of users, 
and applied to the users' computing environment, very specific design decisions 
can be made that will greatly enhance users' ability to use and enjoy the user in¬ 
terface, and consequently the products. 
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Workgroup Computing 


"Although meeting face-to-face is the most direct way of communicating, 
it is not always possible. With all the demands on a professional's 
time, traveling, even if it only means going down a few floors in 
the same building, can be impractical." 

Aileen Crowley, 1993 

The ability to communicate with others who are not in the same place has always 
been a major goal of any computing environment. With the current and future 
combinations of computer hardware, software, and multimedia capabilities, there 
are new and exciting computer-based products that take us beyond simple 



"He's upset because he got his groupware, but he hasn't got a group 
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communication to the world of remote interactive collaboration. The new tech¬ 
nology areas called videoconferencing and groupware make it possible to share ap¬ 
plications and data across telephone lines and computer networks. Images, 
video, and FAX technology can also be incorporated into the communication and 
collaboration process. 

Central to most products in this area is the ability to share data and images 
dynamically in real time. A shared user interface allows users to see and ma¬ 
nipulate data that belongs to any one of the participants. A document or image is 
typically displayed in a work area, often called a whiteboard or chalkboard, that 
can be accessed by all collaborators. Any user involved in the collaboration can 
work with the document dynamically and when the work is completed the 
document is stored in the originating system. One new product, IBM's Person to 
Person/2, was called "an evolutionary piece of software that will help open the 
door to collaborative computing." (Kramer, 1993). 


Collaborative User Interface Issues 

Shared data and a shared user interaction across a network raise some new user 
interface questions that have to be addressed. For example, how can participants 
tell who is moving the cursor and entering data? How can everyone know who is 
working on a part of the object so others can't modify it? Can participants use the 
hardware and software controls to run the video and FAX equipment? 

For example, the Person to Person/2 interface modifies the mouse cursor to 
show that a remote user is pointing somewhere on the screen. The pointer cursor 
changes to a small pointing hand icon with the name of the user controlling the 
cursor below the icon. When looking at a map, for example, each user could dis¬ 
play and manipulate a pointer on the screen during the discussion. When a user 
wants to manipulate the pointer for all to see, he or she simply clicks on the re¬ 
mote pointer button and all participants will see the user's name on the pointer as 
they manipulate it. 

Another interface technique extends the concept of the clipboard throughout 
the network and allows users to share any data immediately. With a collaborative 
clipboard set up for the current session, users can clip items from one user's 
document and share them, allowing other users to paste the items into their 
documents. 

Another product. Aspects, controls user modifications by not allowing more 
than one person to work on a single paragraph at one time. The product provides 
feedback to all users about the current status of information. "When one user is 
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working on a paragraph, the screens of other users are marked with a gray 'lock¬ 
out ' bar in the margin of the paragraph, and the program will tell the others who 
controls that paragraph." (Andrews, 1991). 

These interface examples show how the currently accepted 
interface guidelines and techniques need to be extended to work within the ex¬ 
tended environment we face today and tomorrow. All of the current interface 
guidelines I've discussed in this book were designed for single users working on 
single workstations with information and objects that they probably aren't sharing 
with any other users. Don't assume that these interface guidelines and techniques 
are capable of handling the interface demands of new computing environments. 
But also be careful not to change the basic meanings of common interface actions 
and techniques. The correct way to approach new interaction and presentation 
techniques is to extend or enhance current techniques rather than change them for a 
new environment. The remote user pointer with a name label is an example of 
enhancing the mouse pointer with additional information needed in the remote 
computing situation. 

There are social and cultural aspects of interactive collaboration that also 
must be addressed. Just as work-at-home computing has it's personal and social 
pros and cons, so too do these new areas of remote videoconferencing and group 
computing. It may be a while before groupware catches on. One developer in 
this area, Derek Naef, noted "Changing the way people work takes time." (An¬ 
drews, 1991). Some companies see the immediate benefits. In the same article, 
Dow Chemical's Neil Drake tells why they have gone to videoconferencing, "If we 
want to hold a two-hour meeting and bring together people from Europe, the 
Orient, Canada, and South America, we will lose four days for each person. This 
lets us hold a two-hour meeting in two hours. Most companies implementing 
this new technology agree that it is not as good as being with a person face to 
face, but it is better than being on the phone." The study of organizations and 
collaborative computing needs to become an integral part of university computer 
science curricula. Experts say graduating students in computer science have little 
knowledge of how people work in networked, cooperative environments. 

On a final note, we want to make sure that we don't force people to work the 
way that new technologies demand, as just mentioned. As Buxton (1990) said 
succinctly, "We are beginning to realize that rather than the technology dictating 
the organizational structure, the organization should dictate the technology. The 
key to improved productivity isn't the technology-it's the people and how they 
work." As you should know by now, the user interface is key in the implementa- 
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tion of any new computing technologies. Failure to provide user-centered inter¬ 
faces can doom even the most promising new technologies. 


Interactive Technology 


"The presence of humans, in a system containing 
high-speed electronic computers and high-speed, 
accurate communications, is quite inhibiting." 

Stuart Seaton, 1958 


Just What Is Interactive Technology? 

This is a technology that will have a big impact on consumer 
entertainment of the '90s. It is a way to get the consumer 
involved, instead of just passively watching." 

Stewart Schulze, 1991 


As the multimedia buzzword slowly becomes commonplace, the next buzzwords 
for new technologies in computing are interactive television and the digital informa¬ 
tion superhighway . Pick up any newspaper or magazine and you'll find out about 
the incredible amount of interest and money being spent on the hopes of getting 
the capability of consumer interactivity through your phone line, your cable TV 
line, into your home, and ending up on your television and/or computer. 

A special series of articles on interactive technology were showcased in the 
May 31,1993 issue of Newsweek. The articles are of great reading interest, but it is 
important to note that the section of the magazine readers found them in was the 
Society section, not the Industry or Technology section. Whatever happens in this 
area will impact how we live, work, and play. One article (Powell, 1993) notes, 
"Whenever significant technological change emerges from the research labs, it 
comes to the marketplace on the back of major investments. And when that 
happens-and it is happening now-the face of the American commercial land¬ 
scape changes irrevocably, unpredictably, and often cruelly." 
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CHMDE EE BB There are many technological issues at stake in interactive 
media and it is beyond the scope of this book to discuss them all here. My focus 
is on the user interface, and the technological changes coming will have a tre¬ 
mendous effect on the interfaces of the products you will use at work, at home, 
and wherever else you may be. Historically, interfaces are best designed for au¬ 
diences and tasks that are well-defined. Interfaces are different for computers, 
telephones, and televisions. Right? Well, it may be so now, but it isn't necessarily 
so for the future. This new environment makes user interface design in the future 
an even more important piece of the hardware and software systems built for in¬ 
teractive systems. 


Who's Doing What With Whom? 

"It's a big opportunity for those who understand how to bring value to it, 
and it's a big threat for those who don't." 

Robert Kavner, AT&T, 1993 


You thought the GUI-OOUI war was exciting and competitive? You haven't even 
begun to see just how competitive the interactive media world can be. Why? 
Because everyone is potentially a major player in what is right now a very small 
sandbox, that may become an incredibly huge marketplace. Just look at the cel¬ 
lular telephone market, for example. Although the average monthly cellular 
phone bill is around $70, the U.S. population of cellular phones is increasing 
about 40% every year. 

The major computer hardware and software developers aren't necessarily 
the major players in this new playground. Microsoft's Windows may be the big¬ 
gest GUI around, but that doesn't matter in this environment. Mark Eppley, 
chairman and CEO of Traveling Software Inc., said, "The issue of standards 
doesn't apply. This is a brave new world. In this world, Windows and NT and 
DOS don't carry any weight." (Sherer, 1993). 


K E Y I D E A ! 


What we have is a converging of technologies and industries 
that were once independent: computers, telephones, cable television, entertain¬ 
ment, and video games. This convergence is forcing even the largest companies 
in each industry to form alliances with major players in other industries to just 
stay in the race. 
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US West (a telephone company) just paid $2.5 billion for a 25% share of Time 
Warner's entertainment division (which owns cable TV networks, movie studios, 
and cable TV's HBO movie channel). IBM, Microsoft, and Apple are all separately 
holding talks with Tele-Communications Inc., the world’s largest cable TV pro¬ 
vider. Supposedly, Microsoft is after the consumer market while IBM is more in¬ 
terested in cable efforts in business. IBM already has a joint venture with NBC to 
broadcast news to desktop PCs. You can tell that we are experiencing a conver¬ 
gence of technologies by the new terms being used in the press. Two terms I've 
seen a lot of lately are edutainment and infotainment. 


The Pieces of the Puzzle 

"He who owns the cable box platform 
owns the DOS of the next generation." 

Josh Harris, 1993 

To help you get a better picture of how all this fits together, here are the four ma¬ 
jor pieces of the digital interactive technology (from Sherer, 1993): 

• Information providers 

• Information delivery services 

• Information recipients 

• Software platforms and interfaces 

Information providers are the content of whatever is being presented. This may 
be movies, television archives, publications, reference materials, entertainment 
guides, product catalogs, interactive games, shopping channels, financial services, 
information, records in a database, newscasts, and so on. 

Information delivery services are the means by which providers transfer infor¬ 
mation from its source to its final destination. This includes cable TV, satellite 
transmission, long-distance telephone service, cellular and packet-data networks, 
online data services, and paging systems. 

Information recipients are products that receive the information transferred into 
the home or office, and allow users to view and interact with that information. 
These products include desktop, notebook and laptop computers, personal digital 
assistants (PDAs), home entertainment systems, digital converter boxes, and 
whatever connected or remote input devices will be used with these products. 
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Finally, the software platforms and interfaces are the operating systems, com¬ 
munications programs, database and application programs, and user interfaces 
that provide the software environment where consumers will view information 
and interact with it in whatever ways are possible. 


What Will Interactive Interfaces Be Like? 

"What does the public want? An exciting question, but a futile one; 
for the public itself does not and cannot know what it wants. It can 
only recognize, when confronted therewith, what it has been wanting. 

Brian Hooker, 1917 


"We want the technology to be transparent to people-just turn on 
the TV and hit a button. The complexity behind it will be invisible. 

Alex Gelman, 1993 


The first major hurdle for interactive technology is to create products and services 
that people actually want, at affordable prices. The next major hurdle, everyone 
agrees, is ease of use. Technology by itself may be exciting to developers and en¬ 
gineers. But, says Olafur Olafsson, president of Sony Electronic Publishing Co., 
"Most people when they come home and plop in front of a television don't want 
to interact with anything but the refrigerator." (Powell, 1993). If interactive tele¬ 
vision and computing systems are too complicated for most consumers, devel¬ 
opers will find themselves as unsuccessful in this attempt as they were in the 
home personal computer market. 


KEY IDEA! 


Is the world ready for the empowered couch potato? Get 
ready, because it's coming, and coming quickly. The headlong rush into interac¬ 
tive media is happening so quickly that the first wave of user interfaces for these 
products will most likely be slimmed-down versions of current operating system 
interfaces or subsets of newer operating system interfaces currently under devel¬ 
opment. These interfaces will most likely not be optimal and as user-friendly as 
consumers would like. One reason is the rush to get these products out the door 
and into the marketplace. The second, and major, reason is that we really can't 
figure out yet what will be the best user interface for interactive media. People 
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need to use the technology in realistic situations in their homes and at work, and 
we need to observe and study their behaviors and thoughts while they use it. The 
graphical user interface has evolved based on research and development over the 
past twenty years and even so, we still can’t give users the easy-to-use interfaces 
they desire. I don't see this pattern changing much, except that it shouldn't take 
twenty years to develop usable interactive user interfaces. Alex Gelman's state¬ 
ment above is really more of a goal than a statement of what the first interactive 
interfaces will be. If it were that easy to build interactive interfaces, why don't we 
have easier-to-use onscreen VCR programming yet? 

Starting with users and their tasks, we have a whole new range of informa¬ 
tion and goals to work with. Let's say you are looking to purchase a 1979 Mus¬ 
tang convertible. Today you'd buy a local newspaper, turn to the classified ads 
section, and start looking in the automobile section for American Cars/Ford Mo¬ 
tors. How would you like to be able to sit on your couch and use your remote 
control to show all of the ads for 1979 Ford Mustang convertibles from the local 
paper for the past two weeks on your TV? You can make your own airline and 
hotel reservations by yourselves from your TV or computer. You and your family 
can shop from video catalogs and post notices on electronic bulletin boards on 
your favorite hobbies. 

How about the educational aspects of the information superhighway? Are 
you ready for the electronic library of the future? The Library of Congress has 
asked the U.S. government to help it expand access to its library of over 100 mil¬ 
lion items. All of this information could possibly be available to anyone with 
computer or TV access using a telephone modem, for just a slight fee. How 
would you design a user interface for over 100 million items in a library? It won't 
be an easy task. 

Interactivity also assumes certain user input and system output techniques. 
These will be based on user preferences and the type of system. For example, you 
can't expect to see the same user interface on your large-screen TV as you'll find 
on the personal digital assistant (PDA) that fits in your pocket. The size and 
resolution of display screen will vary greatly, and so will the sophistication of in¬ 
put devices. I'll talk more about input devices a little later. 


Interactive Objects, Views, and Actions 


KEY I D E A ! 


The interactive interface will be an evolution of 
object-oriented user interfaces we see today, such as OS/2. One of the major 
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tures of the OOUI is the concept of multiple views of objects. I've already dis¬ 
cussed this concept in Chapter 8 and shown how multimedia can further enhance 
user views (Chapter 10). One key aspect of interactive media will be the en¬ 
hancement of the user-in-control design principle that allows users to manipulate 
views of objects that have typically not been under their control. The objects of 
interactive media are many of the entertainment and television presentations we 
currently view only passively. Movies, sporting events, shopping networks, and 
game shows have all been viewed from a limited perspective, one chosen by the 
producer of the presentation. Interactive media will allow viewers to choose from 
multiple perspectives and views that are available for each object. 

Users can choose views dynamically. Imagine your family at home, "Instead 
of flipping through the pages of J. Crew or Victoria's Secret, at-home shoppers 
may watch video catalogs with models demonstrating front and rear views of the 
latest gear. Some cable companies are also testing other interactive models that 
allow viewers to choose their own news or select camera angles for sporting 
events." (Powell, 1993). I'm a serious tennis player. I can imagine watching 
Wimbledon or the U.S. Open tennis tournament with interactive TV. Instead of 
watching the match from the standard wide-angle camera showing both players 
and the whole court, I could choose to view the match from either of the player's 
perspective at any time. Other views will give me each player’s statistics for the 
match, for example, using a diagram of the court to show player's shot selections. 

The object-action paradigm of GUIs and OOUIs will also be extended into 
the interactive arena. As you are watching a football game, you'll be able to pause 
the action and choose what the next offensive play will be, or what defense you 
would call. The system will keep track of your answers and let you know how 
you did after the game. You'll also answer the questions along with the contes¬ 
tants on TV game shows. These are all actions and choices that can be made 
based on the type of object you are working with and the current status of the in¬ 
teractive situation. 

The sophistication of the information, the overall level of interactivity pos¬ 
sible, and the number of views available will all determine the customer's cost for 
the services they choose. Enhanced sound and even other sensory information 
could be received at an additional cost. Just as the telephone companies charge 
for extra options for phone service, interactive media may have a whole range of 
sensory and perceptual interface options. Instead of today's limited Pay-Per-View 
TV, we'll have Pay-Per-Sensory Channel interactive Multimedia! 
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Social and Cultural Aspects of Interactive Interfaces 

Technology Enthusiast: "With this new technology merging cable, 
computers, TV, and telephones, we'll watch TV and communicate 
with just about everybody!" Spouse replies, "...except each other." 

David Brown, Jr., 1993 

Researchers have studied the psychology of using computers for many years. 
First, since most early computing was done by the scientific community, the psy¬ 
chology of computer programming was a popular field of study. Today the focus 
is on the usability of computers for both casual and experienced end-users, rather 
than programmers. There is also significant research on the impact of computers 
in education, as I pointed out earlier on the technoculture aspects of the Mac and 
the PC. More recently, attention has turned to the cultural and social aspects of 
using computers, as I mentioned regarding telecommuting and workgroup com¬ 
puting. 

IQEgMBIEOOM With the proliferation of interactive video games among the 
younger generations and the coming of the interactive age for the rest of us , there 
is now a new field of study and research evolving—the psychology of interactive 
media. The emergence of this specialty field show—s how different this brave 
new world is from the traditionally separate worlds of computing, television, and 
entertainment. Dr. Bernard Luskin (1993) notes that specialty techniques such as 
cognitive mapping, cognitive learning styles, and previsualized production will 
become part of the interactive media development process. He defined some new 
fields of interest, "Synesthetics, the study of the combining of the senses, and 
semiotics, the study of the use and manipulation of symbols, will develop in 
terms of their being better understood and utilized by producers and designers of 
interactive media." If you're looking for new career growth, these areas of com¬ 
puter psychology certainly have potential in the interactive multimedia computer 
world of the future! 
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New User Interaction Technologies 


"The mouse will play a diminished role. 

It will be supplanted by pen, finger, and voice input. 

Bill Gates, 1992 


If you don't already know how to use a mouse with a computer, you're already a 
few generations behind the times. At least, that's what the computer industry 
wants you to think. If you're only using your computer to run a spreadsheet ap¬ 
plication to do your business accounting, you may not need a mouse, and most 
likely, can outperform a mouse user on your everyday tasks. In this section. I'll 
take a brief look at some of the latest user interface interaction technologies. 
These include touch, pen and gestures, speech, and other advanced interaction 
technologies. 


Touch 

"Two-thirds of American Airlines' 10,000 pilots-in-training prefer 
touch-screen interaction to standard trackball or keyboard methods." 

Tibbett Speer, 1993 

Touch-screen technology has been around for about ten years but only in the past 
few years has become widely accepted as an alternative to traditional keyboard or 
mouse interfaces. Part of the recent acceptance of touch interfaces is the im¬ 
proved technology involved in manufacturing touch-screen displays and modi¬ 
fying existing displays to enable touch-screen input. The point-and-select inter¬ 
face techniques made popular by mouse-intensive graphical user interfaces is 
easily adapted for touch input. By definition, touch interfaces imply using a fin¬ 
ger as the input and selection device. 

Basic touch techniques emulate basic mouse interactions such as the click, 
double-click, and drag techniques. Numerous studies have shown (Mack and 
Montaniz, 1991) that performance on realistic office task scenarios using a finger 
and touch techniques resulted in comparable performance between mouse and 
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keyboard interaction techniques. However, there are many tasks where extensive 
keyboard interaction is required (such as writing a book!) that would not reason¬ 
ably be attempted using touch-screen techniques. I would not have wanted to 
write this book if I had to use a touch-screen with an on-screen keyboard for all of 
my text entry. Studies have shown that users who type 58 words per minute on a 
traditional keyboard could only type about 25 words per minute using a touch¬ 
screen keyboard (Plaisant and Sears, 1992). They also showed that the traditional 
display position is not necessarily optimal for touch-screen use. 

Of the major user interface guidelines publications, only the CUA Object- 
Oriented guidelines cover touch interfaces. Remember that CUA products sup¬ 
port both mouse and keyboard interactions. Touch is discussed as an additional 
or alternative interface for some products. Some general guidelines or touch in¬ 
terfaces are (IBM, 1992): 

• Pointing with a finger (touch) is a more natural method of interaction. 

Touch may require less dexterity and learning to use them effectively in 
an interface. 

® To use touch input, users find the object or item on the screen and point 
to it directly. There is no mouse pointer that users must find and then 
reposition to perform an action or selection. 

• Touch-screen interfaces may be less intimidating than keyboards and 
mice for novice users. They are often used for public access kiosks and 
for executive support systems. 

• Some users with special needs may not be able to use the keyboard or 
mouse and may be able to use a finger or a pointing instrument to 
touch the screen. 


KEY IDEA! 


To be effective, touch interfaces must have clear visual access 
to the screen to use touch. Users must also get immediate feedback about where 
they have touched on the screen. It may seem obvious to developers, but users 
may not know what elements on the screen are touchable items. Some people 
will explore and touch different parts of the screen just to see if they are interac¬ 
tive. Others will not touch the screen unless the area is specifically indicated to be 
a button or touchable area. 


As with all interfaces, buttons or function keys should be placed in a consis¬ 
tent location in windows or on the screen for all product interfaces. Users will 
develop habits and will rely on spatial cues to make rapid selections using touch. 
Users may also experience some fatigue using their hand in an upright position 
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for long periods. Therefore, if users will be doing extended touch input, the 
screen should be designed so that users may rest their palm on the display or the 
screen and use their finger from that position. In order to reduce user errors, the 
touchable area for an item on the screen should be slightly larger than the 
graphical element on the screen. This allows more error-free performance. 

Although touch-based interfaces are becoming very familiar to the general 
public, many developers do not provide the up-front information to let users 
know that they are encouraged to touch the screen and where they should touch 
the screen to begin their interaction with the system. I've observed many users in 
test situations and people at touch-screen kiosks in public places just stand there 
and watch the screen, waiting for the system to tell them or show them something 
to let them know that they should touch the screen. For some reason, most 
people need some form of attractor screen or introduction just to get them to 
make that first touch. Once they have made contact with the system, they usually 
become comfortable very quickly and do not need further assistance to touch the 
screen. 


Pen Computing 

"We haven't even come close to the potential of the pen scenario. 

Business will pay the piper in these early days to get the 
technology perfected, and as pen computers become more stable 
and less expensive, they'll move to the consumer level." 

Tim Bajarin, 1993 


Using a writing utensil such as a pen is a more natural act than using a computer 
keyboard and mouse for most of the general population. This is simply conven¬ 
tional wisdom and that's just what pen-computing hardware and software de¬ 
velopers have been assuming as they have moved quickly into the pen-based 
computing area. Unfortunately, pen computing hasn’t caught on in the way that 
might have been expected, but this might just be a sign that the boom isn't here 
yet. Today, pen computing is a very specialized area and hasn't yet become us¬ 
able in the consumer market. 

The promise of pen computing is in those user scenarios where keyboard 
input is not needed or not possible, which is mainly in the portable computing 
environment. Pen-based computer products are used by companies such as UPS 
in the parcel delivery industry. 
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There are four major components of pen computing. Using the pen as a 
standard input device is one basic component, where users can make selections 
and navigate in an interface just as they would with the keyboard or mouse. 
Secondly, pen input and handwriting can be captured and stored, for example to 
save signatures for UPS deliveries. Thirdly, pen gestures can be used to perform 
customizable actions and functions, such as document editing. Finally, pen¬ 
computing can include handwriting recognition, which is the most complex 
technological aspect of the pen computing, to allow users to write actions and 
commands. 


KEY IDEA! 


Pen products fall into one of two categories. Pen-centric ap¬ 
plications use the pen as the only input device. Pen-compatible products allow 
pen, keyboard, and mouse input. Some pen systems are based on different types 
of operating systems designed specifically for pen computing (such as the 
PenPoint operating system by GO Corp.). Other systems allow existing programs 
to support pen computing with little or no modification in addition to keyboard 
and mouse input. Microsoft's Windows for Pen Computing, IBM's PenDOS, and 
IBM's Pen for OS/2 are all newly developed systems that enable pen-based com¬ 
puting on the popular computer platforms. Pen for OS/2 actually enables users 
to operate virtually any OS/2, Windows, or DOS program running in an OS/2 
window, using the pen as a mouse. 


While developers are extremely competitive in this area, as in all areas of 
computing, they are also cooperating to draw up standards for sharing pen-based 
data. A new standard, called Jot 1.0, has been defined for sharing pen-generated 
data. This will allow users to share handwritten notes, signatures, and drawings 
across platforms ranging from personal digital assistants to PCs to mainframe 
computers. An alliance of vendors, including Apple, Microsoft Corp., General 
Magic Inc., Lotus Development Corp., and GO Corp. have endorsed this stan¬ 
dard. These activities will help speed up consumer acceptance and alleviate user 
concerns about using pen technology across hardware and operating system 
platforms. 

What's Different about a Pen Interface? In many ways, using pen input with a 
computer is simply an alternative substitute for the keyboard or mouse. Users 
navigate in a graphical interface with the keyboard by using the cursor movement 
keys, text mnemonics, shortcut keys, and function keys. A pen can also work in 
the same way as the mouse for navigation, selection, and direct manipulation. 


New Technologies: 


User Interfaces of the Future 


377 


In general, pens work better in the user interface for tasks where fine motor 
control and direct object manipulation are required. Pens don't work well for 
high-volume data and text entry, so it is less likely to be used for heavy word¬ 
processing and transaction processing activities. 

The basic pen techniques are the tap, double-tap, and drag. A tap is the same 
as a mouse click and is for selecting objects, menus, and controls such as buttons 
and list items. The double-tap is the same as a double-click of the mouse and is 
used to open objects and select words in text. Dragging is also done similarly as 
the mouse to move, size, copy, and generally manipulate objects. 

Pens are also used to input graphic images, such as annotations and signa¬ 
tures, that are not translated into computer-readable form. In these cases, the 
software programs are similar to a graphics drawing program, which typically 
used a mouse to draw graphics or write notes. The data is simply saved as a 
graphic element and is not translated in any way. 

When the pen is used in an interface, certain penstroke patterns, or gestures, 
can be interpreted as special symbols that issue commands (similar to shortcut 
keys) or initiate some action. Gestures allow users to specify both the action to 
be performed, and the objects on which to perform the action. Common actions 
include selection, scrolling, displaying help, displaying pop-up menus, and edit¬ 
ing text and documents. The Windows guidelines (Microsoft, 1992) cover the el¬ 
ements and guidelines for designing pen interfaces. The IBM CUA 1993 guide¬ 
lines, currently under development, also will address pen interfaces. 

Test results (Briggs et. al., 1993) showed that users accepted pen-based sys¬ 
tems for interface navigation and position control across a range of applications. 
In general, participants preferred the pen-based interface to the traditional key¬ 
board and mouse interface, except for text character input. 

Pen Interfaces and Handwriting Recognition Handwriting recognition has seen 
an incredible amount of technological research and development in the pen¬ 
computing area. For most traditional applications, a pen won't replace keyboard 
input of text. Computer users can type from 50 words-per-minute and much 
higher, but pen handwriting and recognition typically tops out at around 25 
words-per-minute. Most environments where pen systems could be used involve 
only limited amounts of text input where a keyboard is not optimal. Here pen- 
based text input rates are not as important as capturing the pen graphics and as¬ 
suring the accuracy of the system's handwriting recognition capabilities. 

There are different types of computer handwriting and they each require 
different levels of technological sophistication to translate them. Boxed discrete 
characters, such as you see on older paper forms that were optically scanned and 
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recognized, are easiest to recognize. Spaced discrete characters are slightly more 
difficult to process. Run-on discretely written characters, like carefully written 
handwriting, have been very difficult to recognize. Finally, cursive script writing is 
the most difficult form of handwriting to recognize accurately. 

There are some useful guidelines and tips for designing 
pen-based interfaces that plan to utilize handwriting recognition. The Windows 
interface guide recommends, "Because handwriting recognition takes extra time 
and may occasionally result in errors that must be corrected by the users, pen 
applications should minimize the need for the user to write text that must be 
recognized." 

They suggest that designers offer pen users list boxes containing choices to 
select rather than entry fields that require users to write their entries. Programs 
should also save pen data as a graphic, such as a signature, whenever possible to 
avoid unnecessary handwriting recognition. Larger handwriting is typically rec¬ 
ognized easier, and it is easier for users to input, so interface designers should al¬ 
low more screen space for pen text entry. Recognition accuracy can also be im¬ 
proved by limiting input fields to numbers, letters, or selected sets of characters. 
For example, a telephone number field will allow recognition to be quicker and 
more accurate if the system knows that numbers are the only valid entries in the 
field. This also applies to graphical input. The system can recognize special 
symbols and draw them appropriately when it knows what to look for. For ex¬ 
ample, a drawing program should quickly recognize hand-drawn circles and 
squares and translate them into perfect symbols. 

Advancements in handwriting recognition have led to an explosion in the 
field of computer-readable forms processing. This area has gotten so sophisti¬ 
cated now that you can FAX a form to your computer for it to read and recognize 
as commands for the computer to perform certain actions or run programs even 
while you are not even there. IBM's Think Write is part of Pen for OS/2. 
ThinkWrite even allows users to improve recognition accuracy by tailoring the 
system to their unique handwriting characteristics. Standard handwriting ges¬ 
tures can also be used to control programs. Pop-up on-screen keyboards allow 
users to write text, numbers, and commands that will be recognized by the sys¬ 
tem. Apple's Newton, a new and highly-touted PDA includes limited handwrit¬ 
ing recognition technology. Users are finding out firsthand that there is more 
pain than promise in the early stages of handwriting recognition in commercial 
products. 
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Speech Technology 

"The key benefits of voice interfaces of the future will be freedom for users, 
who will be able to operate computers 'hands-free', and the removal of 
the keyboard barrier for information technology-shy managers." 


David Mandel Anthony, 1993 


A few things stand between most people and their computers: a display, a key¬ 
board, and a mouse. Most people feel more comfortable communicating with 
each other through speech. However, speech as the main interface between users 
and their computers is still thought to be an immature technology. Much work 
still needs to be done to see where and how speech input and recognition apply 
in the user-computer interface. The potential benefits are visible, however. 
People can type anywhere from 40 words-per-minute and up, but typically can 
speak at a rate of at least 200 words-per-minute. Speech definitely has a place in 
the user interface of the future, but people differ as to exactly where that place 
will be. 

Research and development in speech recognition has been conducted for 
almost twenty years, much of it commissioned and funded by the U.S. 
government's Defense Advanced Research Projects Agency (DARPA). To mea¬ 
sure the progress of speech recognition systems, DARPA defined two tasks that 
programs should be able to perform (Peterson, 1993). 

In one scenario, users question an air travel information system to obtain 
flight data (for example, a list of nonstop flights between two cities on the morn¬ 
ing of a given day). To provide the correct information, the system has to both 
recognize and understand a speaker's words. The second task requires the de¬ 
velopment of a dictation system that can correctly transcribe any sentence read 
aloud from the Wall Street Journal. The emphasis of these tasks is on speech- 
driven database information retrieval and rapid speech recognition. These tasks 
are currently being used to evaluate today's best speech recognition programs. 

The Wall Street Journal scenario requires a database of 20,000 words to rec¬ 
ognize. On today's fastest workstations, experts say typical speech recognition 
systems take 20-30 times longer to process a sentence than it takes to say it. These 
kinds of processing speeds are not sufficient for widespread commercialization of 
speech recognition technology. 

Speech recognition technology has always been limited by hardware storage 
capabilities and processing speed. Digitized speech is very storage-intensive; one 
minute of uncompressed speech takes up one megabyte of disk storage. The vo- 
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Future Problems with Voice Recognition 


cabularies required to check spoken words also require tremendous amounts of 
disk space. The process of comparing recognized words to speech dictionaries 
requires a very fast computer processor. These limitations have slowed the mi¬ 
gration of speech recognition onto the PC platform. Today's increased PC hard¬ 
ware and software capabilities, in combination with decreased costs, have sped 
up the introduction of new products for business and personal use. 

Where does speech recognition apply and how best to use it? Most applica¬ 
tions require specific vocabulary and individual user training before acceptable 
recognition rates can be achieved. Speech systems are useful where limited sets 
of user actions and commands are allowed. The FA A uses speech recognition 
systems in air traffic control towers to record flight plans and for database re¬ 
trieval. The mili tary uses speech recognition for voice commands in fighter 
planes. Voice imprints are used for security programs in many industries. If your 
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voice print doesn't match what's in the computer, you don't get access to wher¬ 
ever you're going, whether it is in person or over the telephone. 

Speaking of the telephone, some of the newest breakthroughs are in the area 
of remote speech recognition via telephones. NYNEX, the New York and New 
England Telephone Company, has developed a first-of-its-kind telephone calling 
service called VOICEDIALING, to be available sometime in 1993. They have 
combined a natural, comfortable form of communication-speech-with advanced 
switching and speech technology. A customer can pick up the telephone, wait for 
a special beep after the dial tone, and then say a name or phrase. A speech rec¬ 
ognizer at the telephone company's central office matches the spoken name or 
phrase with a previously stored speech pattern in a database programmed by the 
customer. Once a match is made, a software program dials the telephone n um ber 
associated with that name in the computer database. The customer has just 
completed a telephone call without touching the telephone dial and without any 
special equipment or need to key in an access code before the spoken name. This 
service can be used from a business or home phone and it doesn't even need to be 
a touch-tone phone. Plans are in place to allow customers to activate other 
network-based services, such as voice messaging and PEIONESMART features, 
again without the need to memorize access codes. Pretty amazing! Well there's 
more telephone wizardry to come. 

A Japanese research company announced automatic telephone interpreting 
early in 1993. A telephone call between Pittsburgh and Kyoto, Japan demon¬ 
strated speaking to a computer in one language on one end of the telephone and 
having it translated into another language on the other end of the line. While the 
ability to chat freely with anyone in the world with automatic interpretation is 
probably twenty years away, limited applications of interpreter telephone sys¬ 
tems will probably be in use before the year 2000. 

There are new products and toolkits that are very promising for developing 
effective speech recognition programs on the PC. For example, IBM has built a 
Continuous Speech Series (ICSS) of programs and has put in place a Developer's 
Program to assist independent software vendors developing speech programs on 
the OS/2, Windows, and RISC System/6000 platforms. ICSS is a speaker- 
independent, continuous speech, 1,000-word active (from an expandable base 
vocabulary of 20,000 words) toolkit for developing speech-enabled and speech- 
aware programs. The Speech Server Series supports up to eight users on a local 
area network and it can take dictation from all users on the network simulta¬ 
neously at a rate of more than 70 words-per-minute. 
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KEY IDEA! 


Speech and pen technology aren't necessarily competing for 
control of the user interface; they can share the interface quite well, they are 
complementary Pen technology can be used to take notes, draw, edit, and fill in 
forms, all in a very quiet way, which is perfect for working in meetings. Speech 
technology can be used to dictate information, speak commands, and retrieve 
data, all while the hands and eyes are busy, and even when the speaker is on a 
telephone from a remote location. 


There are technology and interface issues that must be addressed before 
speech interfaces can be ready for mass consumption. Here are some of the 
technology issues: 


® Error rates must be improved for speech recognition algorithms. 

• Recognition must be able to handle continuous speech, not just isolated 
words. 

• Systems must be able to work with any speaker (speaker-independent) 
rather than just a single speaker (speaker-dependent). 

• Dictionary databases must be enlarged to be able to handle large 
vocabularies and also vocabularies of varying difficulty. 

• Recognition must be suitable for various natural languages. 

• There must be facilities for adding and changing vocabularies. 

• Systems must be able to accept local and remote (telephone) input. 

• Systems must be easily trainable and tailorable for multiple speakers in 
varying scenarios. 

• Recognition algorithms must be able to separate and identify speakers 
from background noise. 

• Systems must offer easy error recovery if incorrect recognition takes 
place. 


It is still difficult to define what speech interfaces will look (and sound) like, 
but there are some basic interface concerns that must be addressed, in addition to 
the common interface design principles and guidelines already discussed: 


Adaptation to users: sensitivity to variations in users' speech due to 
physical and emotional states. For example, you should be able to use a 
speech recognition system even when you have a bad cold or you are 
screaming because of an emergency situation. 

Programs must be able to "read" screens and elements from GUI and 
OOUI interfaces that are not necessarily enabled for speech. 
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Ease-of-learning vs. ease-of-use: speech programs today offer high 
accuracy and recognition speed during use by requiring extensive 
training by all individual users. Programs in the future must also be 
easy-to-train. 

There must be very easy ways for users to correct incorrect recognition 
or undo commands if they change their minds. 

Systems must be able to work in real-time, that is, within acceptable 
response time limits comparable to keyboard, mouse, touch, and pen 
interaction. 

Most interfaces allow multiple interaction techniques, including key¬ 
board, mouse, touch, and pen interaction. Users today can speak 
without worrying if their computer is going to do something based on 
what they say. Care must be taken to ensure how speech is integrated 
into this interface environment. 

Even more care must be taken in designing speech-only interfaces. 
Everything that can possibly be done must have some speech command 
or technique that is learnable and intuitive for users. 


New Input Directions 


"GUIs have stifled, if not brought to a standstill, the use of computers 
by blind and learning-disabled people. New technologies, such 
as a graphics-based speech package from IBM, are evolving that 
may restore the independence computers once provided." 

Richard Schwerdtfeger, 1991 


Some of the most promising benefits in the area of user interface technology are 
for users who have special needs. Blind and physically disabled people have 
traditionally had a disadvantage in the computer-oriented workplace. The 
American Foundation for the Blind says there are more than 120,000 people in the 
U.S. that are legally blind. In addition, another ten to fifteen percent of the U.S. 
population have learning disabilities. The evolution of the graphical user inter¬ 
face, while visually stimulating for most people, doesn't work for visually im- 
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paired users. A special type of software programs called screen-reader systems 
(SRDs) have been developed to read what is on the screen out loud for users. 
While these programs worked well for character-based interfaces with physical 
display text buffers, they couldn't handle the new graphical user interfaces, with 
all the windows, buttons, icons, and so on. However, new programs have been 
developed, such as IBM's Screen Reader/2 for visual user interfaces, such as 
OS/2. IBM has a special program for users with special needs. It is available by 
contacting a branch office or the IBM 1-800 sales number. 


KEY IDEA! 


These programs are part of the adaptive software market that 
now has some additional incentives for growth. Two new national laws have 
helped development in this area. One law specifies that a company can sell a 
product to the U.S. government only if that product is accessible to people with 
disabilities. The second law is the Americans with Disabilities Act, signed by 
George Bush in 1990, states that if a company has more than 25 employees, it 
must provide reasonable accommodation, including technology, in the form of job 
adaptations for the handicapped. This means that an employer must provide 
special computer equipment if some workers have hearing, vision, or physical 
disabilities that limit their use of regular computers. Screen readers, audio 
equipment, and special physical input devices are now readily available for al¬ 
most any type of computer. 


One study (Casali, 1992) had twenty people with impaired hand and arm 
function perform a target acquisition task on the computer using five cursor con¬ 
trol devices: a mouse, trackball, keyboard cursor keys, joystick, and a tablet. 
They were asked to move the mouse cursor around the screen to select icons 
placed at random in different parts of the computer display. The results were en¬ 
couraging, "Even persons with profound impairment were able to compensate for 
their disability and operate each device by using minor device modifications 
and/or unique operating strategies." Regardless of the physical ability of the us¬ 
ers, the rank ordering of the devices with regard to the time it took to reach tar¬ 
gets was the same. The mouse, trackball, and tablet provided better performance 
than the keyboard cursor keys, which provided better performance than the joy¬ 
stick. Dragging objects was a problem for people with motor control limitations, 
and so was selecting small target icons. Research in this area will help improve 
both hardware and software for users with special needs. 

There are some new and interesting interface interaction techniques on the 
horizon that may burst forth as viable interface components sometime soon. Eye 
movements have been tinkered with as an interface selection for a number of 
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years. The idea is that users could focus on objects on the screen and then per¬ 
form actions using any other interaction technique. The eye-tracker e lim inates 
users having to physically move a pointing device or cursor keys around the 
screen to select items. You just have to look at an object to select it. Users could 
also focus on buttons to perform actions. These systems also have practical uses 
for users with special needs as I just described. They can also be used where us¬ 
ers are doing other things with their hands and cannot switch from their tasks to 
move pointers on the screen. 

I've followed this area closely because I used eye movement measurement 
technology to do my graduate work in cognitive psychology on how people read. 
Most of the eye tracking systems have been used by the military, the advertising 
industry, and for computer and educational research. A few years ago, Wang 
came out with a head-mounted eye movement tracker for their office workstation 
system. I didn't see many of these systems around and I don't believe that the 
time has yet come for common computer use for these systems. They are already 
being used or tested in specialized areas. The military uses them for pilots to se¬ 
lect objects in their vision simply by locking their gaze on them. Advertising 
agencies used the technology to watch where people look when they read printed 
advertisements or watch commercials on television. Computer and education 
researchers use eye-trackers to watch where people look on computer screens and 
to see how people read and view pictures so they can better understand the hu¬ 
man visual and cognitive systems. 

We may be able to use other body parts and gestures as interface elements in 
the future. Body language such as shrugs, smiles, winks, laughs, and gestures 
could also be used to enhance the user interface and our communication with 
computers and other users. 


On the Fringe: ESP Interaction 

By far the most futuristic interface interaction technique I've read about is the use 
of brain waves to interact with computers. In February 1993 I read two brief 
notes in the New York Times and Business Week. Japanese researcher at Fujitsu Ltd. 
and Hokkaido University attached electrodes to subjects' heads and instructed 
them to control the computer by thought. All they have measured so far is some 
kind of electrical activity that starts in the back of the brain which is followed by a 
quick response. Nippon Telephone and Telegraph scientists say they can tell from 
brain waves the direction a person wants to move a joystick. In this same area of 
research. New York State Department researchers have developed a system that 
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allows users to move a computer cursor up and down or side to side by mental 
activity alone. 

This should give you some things to think about on the way you and other 
users will be interacting with computers in the future. Perhaps the phrase I 
quoted earlier, "I think, therefore icon" can eventually be changed to "I think, 
therefore I can move that icon from here to there." 

New technologies and software programs such as interface agents and vir¬ 
tual reality will totally change not only interface interaction techniques, but the 
ways we do our work and the ways we use computers. Let's look at these new 
areas. 


Interface Agents 


"Many industry watchers expect the computer's relationship 
to the user will change from that of a productivity tool to that 
of an active collaborator." 

Bill Buxton, 1991 


Many people share the feeling that we have become inundated by the amount of 
information we have to deal with on the computer and haven't figured out how 
all this wonderful new technology can help the way people will be working with 
information and computer interfaces now and in the future. Richard Dalton 
(1993) remarked "The first thing that struck me when I reviewed the Information at 
Your Fingertips tape again was that the title should have been 'Data at Your Fin¬ 
gertips.' That isn't just a semantic quibble. We’re all pretty much awash in every 
kind of data these days. Maybe it isn't all delivered to your desktop instantly, as 
it was in the video, but that's probably good." 

There is an incredible amount of information that most of us have access to 
and we must somehow wade through that information to do the things we want 
to do. Not all of us are excited about the prospect of having over 500 TV channels 
promised by cable TV companies or instant access to public libraries full of pub¬ 
lications. The complexity of dealing with all of this information leads many of us 
to think that we could use some intelligent support in this area. There are also 
many routine and repetitive tasks that we must do in our use of computers that 
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could be easily automated in some intelligent way. There are two avenues where 
software developers are working to help computer users: more intelligent soft¬ 
ware systems and programs, and intelligent assistants, or agents, as they are 
called, for computer systems. Agents are autonomous processes in the computer 
that act on behalf of users in some specified role. 

Many of today's mainstream software developers are slowly incorporating 
more intelligence into their programs. Electronic mail programs should be able to 
filter mail and information according to users' preferences and requirements. 
Harvard Graphics 2.0 provides an Advisor, which offers suggestions on how us¬ 
ers can optimize their presentations. Advisor can recommend to users (via a dia¬ 
log box) to select a pie chart instead of a bar graph to illustrate their data when a 
pie chart is more appropriate. 

Other more traditional applications are using the computer's ability to re¬ 
member users' actions and provide easy access to those actions. For example, 
Nielsen (1993) points out that many current word-processing applications keep 
track of the files that have recently been used and present the last five or so files 
in the File menu bar pull-down for easy access. The assumption is that recently 
used files are likely to be among the more frequently used files in the future and 
should be made more easily accessible. 

A Macintosh program called Rae Assist, a personal information manager 
(PIM), offers users support that simplifies data entry and retrieval and helps users 
create links between objects. For example, when creating a new entry in the 
People module, users can enter both the first and last name in the first-name field. 
Assist parses the entry, places the last name in the last-name field and leaves the 
first name where it is. After entering a phone number, users can add an addi¬ 
tional number or FAX number by entering the different digits. Assist automati¬ 
cally enters the same area code and telephone exchange. 

These are examples of simple things that programs can do to make life much 
easier for users, without adding much to the programs themselves, except per¬ 
haps a little more intelligence and support from the designers and programmers 
of the product. 


KEY IDEA! 


The difference between smarter programs and software 
agents is that agents will actually learn from user behavior. The amount and type 
of learning will determine the "intelligence" your agent provides. Researchers at 
MIT are looking into the learning capabilities of software agents (Santo, 1993). 
Users should be able to describe hypothetical situations and actions and an agent 
would build a database of example situation-action pairs. When these situations 
arise later during actual use, the agent would respond with an appropriate sug- 
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gestion. These systems move us into the more complex computing area of expert 
systems. 

Software programs are now available to automate system and program tasks 
that are performed regularly. These programs monitor user performance and can 
suggest actions that can be automated by interrupting and asking questions. For 
example, if the program sees you starting a certain program every morning at 
9:15, it will ask you if you wish the program to be started automatically every 
morning. You can then modify the agent’s behavior so that the program is only 
opened on workday mornings, not on the weekends. The agent could monitor 
your stock portfolio and let you know when there is any significant rise or fall in 
the price of your stocks. 


What Really Is an Intelligent Interface? 

"Such an agent would be a kind of artificially intelligent alter ego, 
a software reflection of its user, knowing something of your style, 
your interests, and your work habits. It could learn to guess the 
kind of information you need to complete a project and respond 
intelligently to your desires, almost before you've expressed them." 

Andrew Himes and John Anderson , 1989 


Once you get beyond the hype associated with intelligent agents and delve into 
this exciting area, there are plenty of serious questions that must be answered. 
For example, what makes an interface intelligent for a novice, casual, or an expert 
user? What media should be used by an intelligent interface for input and out¬ 
put: text, graphics, animation, speech, or video? Nielsen (1993) notes, "The 
eventual goal of some researchers is to have highly intelligent agents that know 
the user's schedule, can retrieve exactly the desired information at any given time, 
and in general combine the functions of butler and secretary." 

Although the implementation of intelligence in computers is a fairly recent 
phenomenon, research in the general area of computer intelligence has gone on 
for many years. One of the best discussions of the basic concepts in this area is by 
Rissland (1984). 

Intelligent interfaces must learn from users and the computer. To learn, there 
must be a source of knowledge. Rissland lists the sources of knowledge that in¬ 
telligent interfaces must have access to: 
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• Users-their expertise, style, preferences, and history 

® Users' tasks-the context, purpose, and ultimate use of the results 

• Users' tools-how invoked and used, defaults, preferences, and costs 

• Users' domain-structure and representation of the environment 

• Interaction modalities-interface input/output, command syntax 

• How to interact-when to intervene, adapt, wait, and respond 

• Evaluation knowledge-helpful or hindering, overall effectiveness 

The article also lists some items that embody the desired goals 
of intelligent interfaces. If you are designing or developing user interfaces, see 
how many of the following items you have addressed in your design or your 
product. If you're a user, use this list to evaluate the products and interfaces you 
use. See just how intelligent the interfaces are that you develop or use. Here are 
the services an intelligent user interface should provide: 

• Carry out menial tasks 

• Automate routine tasks 

• Provide assistance with more complex tasks 

• Provide easy access to tools 

• Provide status information 

• Provide online assistance and documentation 

• Allow multi-tasking 

An intelligent user interface should provide these services in a certain style. 
The style should be one that: 


Is helpful and forgiving 
Encourages experimentation 
Minimizes errors 

Allows users to manipulate objects and tasks directly 
Allow users to see directly the results of their actions 
Doesn't get in the way 
Is under users' control 

Adapts to users' styles, preferably with explicit directions 

Unambiguous and consistent 

Has a repertoire of good presentation services 
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Finally, intelligent user interfaces should be understandable, that is, the inter¬ 
face should: 


* Be learnable through conceptual models, and not just by rote 

• Aid the transition from novice to expert 

® Allow users to "macro-ize" and customize tasks 


KEY IDEA! 


Do these items look somewhat familiar? Well, they should! 
What I find interesting after reading these lists is that this article was written in 
1984, almost ten years ago. These concepts were not standard in the interfaces 
then. Most of these goals and styles have since been incorporated into the well- 
accepted, common user interface principles and guidelines for graphical and 
object-oriented user interfaces. While we don't necessarily call the interfaces we 
use today "intelligent" they are very much more intelligent than the interfaces of 
ten years ago. Just think what we'll say about the intelligence of interface agents 
and the user interfaces we'll be using ten years from now! 


User Interface Issues with Agents 

"You may he spending many hours of your day with a 'person', a 
computer agent, an electronically created personality that acts as 
your personal assistant; arranging meetings, finding information, 
making travel arrangements and reminding you that it's time to pay 
the phone bill, get the car serviced, or send a birthday card to your mother. 
The 'personal' in personal computing will take on a very different meaning. 

John Collins, 1992 


Just how do users interface with an intelligent computer? Very easily, I hope! The 
value of an intelligent system is that it understands its users and makes their in¬ 
teraction with the computer as easy as possible. 

One very important feature is that users must be able to modify the levels of 
control the interface and any intelligent agents have. Users at different skill levels 
will feel differently about the amount of control the interface assumes. Novices 
may enjoy gentle guidance from the computer, but may not totally trust a power¬ 
ful interface agent. They will gradually build trust in an intelligent interface that 
patiently learns their habits, makes suggestions, and explains why it makes a cer- 
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tain suggestion. Experts may feel comfortable about a higher level of control by 
an interface agent, but under certain tasks may not want the computer to assume 
absolute control. Think of all the science-fiction movies where smart computers 
take over control of the strategic military functions and begin World War III. 

Just what does an intelligent interface agent look like and how does it inter¬ 
act with users? Advances in speech recognition technology will enable a com¬ 
puter to comprehend spoken commands and "talk” to users. Visualization and 
animation techniques could also be used to give agents humanlike faces and fea¬ 
tures. We assume agents will be humanlike, but they don't necessarily have to be. 
Santo (1993) noted, "MIT researchers used animated versions of retriever dogs to 
represent their information retrievers and are quite pleased with the analogy. 
They argue that since people are used to the idea of breeding generations of dogs, 
they would also be more inclined to accept the idea of training generations of in¬ 
formation retrievers." 

There are also social and cultural aspects of computer agents. By their very 
nature, agents contain lots of information about users' personal computing habits 
and preferences. There are plenty of people and agencies that would like to tap 
into this information. Your employer, the government, and advertising agencies 
all might be interested in talking with your personal computer agent. "Where 
there are agents, can counter agents be far behind; spies who might like to keep 
tabs on the activities of your electronic butlers?" says Kantrowitz (1993). She also 
discusses MIT research where they believe that one day agents may even com¬ 
municate with agents from other users. If two people like the same movies, their 
agents might get together and find out there are many more interests in common. 
You may see a whole new computer-based version of TV's The Love Connection ! 


Virtual Reality: Is It an Interface? 


"The reality of virtual reality will most likely integrate itself gradually into 
our everyday lives through our business toys without our taking notice." 

Mac The Knife, 1993 


Virtual reality (VR) has been spoken of as the third era in human-computer inter¬ 
faces. In the first era, the computer was a very simple, straightforward inanimate 
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machine which received input and produced output. In the second era, computer 
systems gained some intelligence and can carry on a dialog between the system 
and users. In the third era, the system emulates a particular environment that is 
constructed within the computer. Users interact with the reality rather than the 
computer. The goal is to remove the barriers between the human mind and the 
computer. VR systems offer presentations in three dimensions for the eye, ears, 
and hands. Head, eye, hand, and other body movements, and speech, are all 
used as input devices. 

Dreams of virtual reality have been around for a long time. Remember the 
movie Fantastic Voyage ? Even back in 1966 we could see scientists shrinking 
people and injecting them into the human blood stream. Viewers followed their 
travels through various body organs to the heart. On a movie screen, it was as 
close to really being inside the human body as had ever been experienced. That 
was the first taste of virtual reality for most of us. 



The Virtual Office 
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Today's VR systems are hampered by computers with inadequate computing 
power, tracking devices that are too slow and cumbersome, and displays that are 
not mobile and are not capable of required advanced graphics and resolutions. 
Many experts and visionaries predict that their growth will be through the enter¬ 
tainment industry. Entertainment hardware and software developers have em¬ 
braced virtual reality and have already produced some amazing arcade games. 
Entertainment arcades will offer systems where twenty to thirty people will be 
wired into a network and will play in the same game. Three companies. Visions 
of Reality, Kaiser Electro-Optic, and Sense8, joined forces in 1993 to create virtual 
reality-based entertainment. Sense8 has already licensed it's technology to NASA 
to create a virtual reality robotics application for use in planetary exploration. But 
the real money is in entertainment. 

There are three types of computer-generated reality: total immersion, aug¬ 
mented reality, and projected reality (Pimentel and Teixeira, 1993). In total im¬ 
mersion (what most people think of as virtual reality), the real world is blotted out 
entirely in favor of some substitute. Users are brought totally into the 
computer-generated world where their visual, aural, and tactile senses are stimu¬ 
lated. For example, advanced flight simulators use video screens in place of 
cockpit windows. Architects and builders can render buildings for their custom¬ 
ers in three-dimensional space. Customers can walk through the building before 
any money is spent on models or manufacturing. Other applications areas are the 
military, environment, and medical fields, where virtual reality can allow simula¬ 
tion and training that could not be attempted in the real world. 

Augmented reality provides computer-generated images and sounds that are 
projected onto the real world to merge with whatever else users view and hear. 
Some examples are heads-up displays used in military aircraft and in cars to view 
control panels while users are focusing straight ahead through a windshield. As¬ 
sembly or manufacturing workers could use VR systems to superimpose visual 
presentations such as parts diagrams or structural layouts directly on the objects 
they are working with. 

Projected reality is somewhere in-between these two types of systems. Users 
can view and interact with a computer-generated presentation that is separate 
from the rest of their real world. Typically the computer-projected presentation is 
viewed on a large video monitor while users can interact with the presentation 
using sensors attached to their bodies. 
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The Psychology of Virtual Reality 

"Computers are theater. Interactive technology, like drama, provides 
a platform for representing coherent realities in which agents perform 
actions with cognitive, emotional, and productive qualities." 

Brenda Laurel, 1993 


"By freeing us from the confines of today's two-dimensional approach to 
computing, the PC will free us to think and work in a whole new way ." 

Preston Gralla, 1993 


Virtual reality almost goes in the opposite direction from everything else I've dis¬ 
cussed here. Other interfaces try to make an established barrier between users 
and the computer-the interface itself-easier to use and as transparent as possible 
for users to work with their objects. Virtual reality serves to reduce or totally 
remove the barriers between users and the objects they want to interact with. 

Interesting psychological challenges exist in the field of virtual reality. My 
wife has flying dreams, like many people, and would love to experience the feel¬ 
ing of flying under her own power. However, at the same time, she is slightly 
claustrophobic and sometimes has difficulty flying in airplanes. How would she 
react in a virtual reality flying scenario? I don't know, but we need to prepare 
ourselves for peoples' physical and psychological reactions to the virtual reality 
experience. 

Rosenthal (1993) mentions an interesting medical case where a fifty year-old 
man, who was blind from birth, had his eyesight medically restored. This case is 
studied in depth by neurologist Oliver Sacks (1993) in an article titled, "To See and 
Not See." As you know, blind people can "see" using their other senses. In this 
case, the patient was "unable to fully process the new information and gradually 
lost even the limited visual ability he had regained." Just as some people have an 
ear for music and an eye for art, some people may have an eye, ear, and feel for 
virtual reality. But, on the other hand, some of us may not! Certainly perceptual, 
physical, and cognitive skills must be trained and can vary with age. Designers of 
virtual reality systems should understand the principles and guidelines of user 
interface design, and should especially focus on matching the sensory, perceptual, 
and cognitive capabilities of users to the virtual experience. 
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User Interface Directions: Beyond the Desktop 


"The desktop metaphor is kind of over the hill now. 
We're ready for something new." 

David Liddle, 1990 


Where We're At and Where We're Going 

As you've realized from reading this book, the move to graphical and 
object-oriented user interfaces is not necessarily a smooth path. Many pro¬ 
grammers are still focused on function-oriented rather than object- and user- 
oriented interfaces. Nielsen (1993) observed five groups of experienced 
character-based interface designers while they designed their first GUI. Four of 
the five groups implemented function-oriented features in their designs where 
object-oriented features would have been more appropriate. The fifth group only 
avoided this situation based on advice from an outside consultant. A follow-up 
study of one group seven months after the study found eight of ten usability 
problems with a GUI prototype interface were due to a lack of object-orientation. 

Before we move on to the next generation of user interfaces, 
we first have to raise the level of consciousness and skill of interface practitioners 
to the programming and user interface environment where the focus is on users, 
their tasks, and the objects they work with. Traditional programmers and de¬ 
signers still work within a structured, function-oriented, procedural environment 
that focuses on computer function rather than user behavior. There really is a 
paradigm shift that they have to make to move from one environment to the 
other. 

The interfaces of the near future will build on the object-oriented interfaces 
we are just now putting in the hands (also eyes and voices) of computer users. 
The focus may expand beyond the strict object-orientation paradigm we are now 
working with, to focus on user-oriented and task-oriented approaches. For ex¬ 
ample, even with objects, users must follow the appropriate syntax of object- 
action or possibly action-object to perform a task. Future interfaces will relax the 
rigid syntax requirements of today's interfaces and allow for a much more natu- 
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ral, syntax-free interface environment. Pen gestures bypass the syntax of select¬ 
ing an object first and then specifying an action. By making an editing mark di¬ 
rectly on a paragraph of text, it is automatically implied that the object is the text 
on which the gesture was drawn. 


Improvements in User Customization 

Another area of improvement in the interface will be the level of customization 
and personalization available to users. Newer products and systems allow users 
to customize more and more aspects of the user interface. However, that applies 
only for the particular workstation they are working on. Why can't I carry my 
personalized system and object settings and preferences from machine to ma¬ 
chine? 

While working on this book, I had to switch between at least three different 
computers, sometimes daily. I used one computer at the office, one at home, and 
a third, a notebook system, while travelling. How did I make sure I was always 
working with the latest versions of each chapter and was using the same program 
settings? I used a very low-tech method—I always carried a set of diskettes with 
me wherever I went. Every time I finished working on one computer, I copied to 
diskette every file I had changed during that session. Then, before I started on a 
different machine, I copied the new files to the hard disk of that system. This 
technique is certainly not extremely friendly and certainly not optimal, but it was 
the only acceptable solution at the time. 

User interface architects have discussed the idea of a "briefcase" for users, 
where they could keep all of their preferences in one place and transfer them from 
system to system. Unfortunately, we haven't been able to implement this yet for 
GUIs or OOUIs. The Department of Defense is also interested in this area. They 
want soldiers to be able to tailor a GUI to their own needs. The Pentagon would 
like to achieve a balance between developing individual applications and provid¬ 
ing the ability to personalize the interface. They are even looking at using smart 
card technology to give soldiers a personalized "dog tag" that would contain all of 
their personal information and preferences for the GUI. 


What's Next for the Desktop? 

The currently published interface guidelines by the Big Three (Apple, IBM, and 
Microsoft) don't cover much of these new technologies. As I said earlier, it is dif- 
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ficult to define guidelines for interfaces that people haven't had much time to 
work with on their computers. We have to learn how people will use new inter¬ 
faces and input technologies before we try to standardize on specific presentation 
and interaction behaviors and techniques. 

Touch, pen, and multimedia interfaces are the areas we know the most about 
today and are beginning to provide guidance to designers and developers. 
Speech and virtual reality interface guidelines are a few years out and you prob¬ 
ably won't see guidelines there for a while. 

I've already given you some idea where both Microsoft and IBM are plan¬ 
ning to go with the next iterations of their operation systems. Let me summarize 
what is going on at the desktop. Microsoft's Windows is an incredibly popular 
GUI, but it is not an object-oriented interface. Microsoft is planning to move to 
the object-oriented desktop environment with their future Windows NT Cairo 
project, but that will be a few years away. The fact that Microsoft is going OOUI 
tells you that although Windows is the standard GUI on PC desks today, they be¬ 
lieve the direction IBM has gone with the OS/2 object-oriented Workplace Shell 
interface is the right direction. 

IBM is working to evolve the OS/2 OOUI with new interface enhancements 
based on the forthcoming CUA1993 specifications. Meanwhile, IBM is spreading 
the OOUI around with its DOS 6.1 product due in 1993. The new DOS interface 
will be a version of the Workplace Shell interface. They are also moving the 
object-oriented interface onto the Unix platform with the Common Open Soft¬ 
ware Environment (COSE) user interface. IBM is working with Hewlett-Packard 
Co., the Santa Cruz Operation Inc., SunSoft Inc., Univel Inc., and Unix System 
Laboratories Inc. The COSE effort is designed to standardize the Unix desktop 
with a combination based on the Open Software Foundation (OSF) Motif specifi¬ 
cation and elements of products from the member companies. COSE's main focus 
is to fight off Windows NT in the Unix environment. Taligent is the new 
object-oriented operating system being built from the ground up by Apple and 
IBM. Pieces of Taligent's object technology are already beginning to be released 
and folded into operating systems such as OS/2. 


What Are Developers Supposed to Do? 

Software developers today are faced with acronym soup when they seek to 
choose their software development and end-use environments. What operating 
system and interface should they use? MS-DOS, IBM-DOS, Mac, NT, OS/2, 
Workplace OS, Cairo, COSE, Taligent? Although it is a real dilemma today, there 
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is help coming. Theoretically, developers shouldn't have to worry about which 
environment their products can run on. Program development tools should be 
able to take their code and create versions of the program that will run on any 
software platform. Platform-independent software? Are you kidding? No, I'm 
not! The current and future program development and interface builder tools 
will allow designers and developers to build the best programs, objects, and in¬ 
terfaces for their users and allow them to use them on different hardware and 
software platforms. The major system software manufacturers are also working 
to ensure that their software and technologies aren't limited to only one platform. 

Finally, there's one more area where object technology will benefit users. 
Today software applications are monolithic packages that cannot be separated 
into individual chunks. So when you buy one word processor, you get a spell¬ 
checker built in to the product. You pay for this both when you purchase the 
program and in disk space it takes up on your computer. If you also use another 
word-processing package, it too will have its own spell-checker. You have to keep 
a personal dictionary for each program's spell-checker to do your work. This will 
not be acceptable in the near future. Software will be developed and sold as 
component object modules rather than major applications you use today. Software 
developers will build objects and little applications they'll call applets, modules, 
tools, or even "oblets" (a combination of object and applet). This means you'll 
purchase any number of word-processing modules (without built-in spell check¬ 
ers) and only need to buy one particular spell-checker applet you like best, and it 
will work with all of your word processors. Using component software will have 
a direct impact on user interfaces. Component objects will be easier to install and 
will enable users to work with different objects and programs from different 
software companies with the same interface metaphors and interaction tech¬ 
niques. Right now, even using a spell-checker is different from application to 
application, so there is little transfer of knowledge from program to program. 


What's in a Name: Will the Desktop Remain? 

With all of this new technology—touch, pen, speech, multimedia—will the desk¬ 
top metaphor we are just now becoming familiar with live on? It probably will 
not be THE interface metaphor forever, but it is the best thing we've got right 
now. These new technologies will first be used to enhance the desktop metaphor 
and improve user productivity and satisfaction. A few years down the road the 
same technologies will have matured and perhaps then they will be ready to take 
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us to a new and better interface metaphor. Here are a few examples of how new 
technologies will be improving the PC desktop interface. 

General Magic is a new company based on an alliance between AT&T, 
Apple, Motorola, Matsushita, Phillips, and Sony. The goal of General Magic is to 
act as the integrating force for the combined skills of the alliance to make com¬ 
puting, communications, and information available anytime, anywhere. When 
the company was unveiled in 1993, they showed a videotape demonstrating the 
front-end interface for telecommunications functions. MacWEEK (Gore, 1993) 
reviewed an early version of the product. The interface metaphor is a three- 
dimensional representation of an actual office, complete with rooms, doors, 
hallways, and common office objects. Different doors will give users access to 
different communications functions and services. So, the desktop lives on! The 
metaphor is extended outdoors when users walk down Main Street where build¬ 
ings represent other available services. Three-dimensional desktop, office, and 
other metaphors are the next logical extension from the two-dimensional inter¬ 
faces we use today. 


KEY IDEA! 


Virtual reality researchers have already begun work on creat¬ 
ing 3-D virtual desktops and offices. Imagine being able to actually walk up to a 
file cabinet, open it, take out a folder and then take out an object from the folder. 
These types of interfaces actually present users with the real-world, three- 
dimensional objects that were the basis for the creation of the desktop metaphor 
on the computer's two-dimensional screen. We've come full circle! 


Xerox PARC, the folks who gave the computer industry the creative push 
along the road to GUIs, continues to work on new user interface technology. In 
the past few years, they have developed an interface that incorporates color and 
real-time, three-dimensional, interactive animation. This interface is called the 
Information Visualizer. It is an experimental interface designed to help users 
manage large amounts of information they need for their work. Clarkson (1991) 
describes the interface that uses the mouse and was designed for business users, 
rather than technophiles using 3-D goggles and gloves to interact with a virtual 
world. This interface also uses the metaphor of rooms to organize information. 
Xerox PARC researchers developed a window management system called Rooms 
to manage users' virtual workspaces in the Information Visualizer. Remember the 
briefcase object I talked about earlier? Well, Rooms allows users to put things 
into pockets to carry them from room to room. This makes the task of moving or 
copying data from one place to another a simple real-world task users can un¬ 
derstand. 
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These new technologies will also allow us to design more realistic represen¬ 
tations of other environments. The virtual office interface becomes less useful as 
we move to different environments, such as manufacturing, control rooms, data¬ 
base retrieval. It will become easier to develop the appropriate interface meta¬ 
phors for these environments. New technologies will allow us to more closely 
match users' conceptualizations and interactions in the real world to the com¬ 
puter representation of that environment in two- or three-dimensions in the user 
interface. 


Moving the Interface to the Consumer and the Copier 

I talked earlier on the move toward interactive TVs, PDAs, and computers. Office 
workers will also gain from software development efforts moving beyond the 
computer to communicate with other machines we use at work. 

Apple, Microsoft, IBM, and others are busy designing user interfaces for in¬ 
teractive TV and personal computer users in the home. Apple demonstrated a 
new GUI for interactive TV, called EZTV, in June 1993. John Sculley, then Apple's 
chairman, told the crowd at Digital World '93 that Apple had been working on 
EZTV for some time and hopes to introduce it by year-end 1993. The look and 
feel of EZTV is supposed to be quite different from the popular Apple Macintosh 
interface. The interface will let several television programs run in multiple on¬ 
screen windows. It also will allow viewers to get updated statistics on players in 
sporting events and enable virtual shopping. Remember my discussion earlier 
about these aspects of interactive computing? 

Microsoft's interface, code-named Utopia, will require Windows 3.1 but will 
not use the Windows GUI, rather a new interface that is designed specifically to 
appeal to nontechnical users. The Utopia interface uses a house metaphor with 
different rooms, as well as an interactive animated character that offers help as 
users navigate the interface. 


KEY IDEA! 


Simple, interactive interfaces in the interactive media age 
should not involve going back to the full-screen menu interfaces we've already 
evolved beyond quite a few years ago. I've seen too many "Video-On-Demand" 
systems in hotels that are just crude full-screen menus leading along a path to se¬ 
lecting a movie from among a categorical listing of current offerings. Interactive 
TV users deserve better than that. 
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Also in June 1993, Microsoft introduced a new set of software called 
Microsoft at Work. It is designed to impose a common language on office 
equipment and make it easier for copiers, FAX machines, telephones, and other 
machines to talk to each other. The program is compatible with Windows 3.1, so 
developers can begin building programs and add-on utilities to allow users to 
easily control office equipment from their PC. The devices themselves—the copi¬ 
ers, FAX machines, and so on—will also need to be modified to provide simplified 
operations through touch-screen or LCD graphical user interfaces. 

The effects of Microsoft At Work on the user interface for PCs shouldn't be 
too much of a distraction. In the Windows GUI, users will work with new pro¬ 
grams for accessible office equipment or new functions in updated versions of 
their software programs. If they are well-designed, these new programs and 
dialogs shouldn't require much new learning or confusion. 


KEY IDEA! 


This type of software technology fits even more easily into the 
object-oriented world of OS/2. New machines that users can interact with would 
simply show up as device objects on their desktop. The views associated with 
each device would be appropriate to that particular object. Like today's printer 
object, a copier object would have a settings view and various contents views, 
showing either icons or details of the jobs sent to the copier. The settings view 
would be a notebook containing all of the various settings and options for the 
copier. In the OS/2 interface, users could also create multiple objects for the same 
device, each having different settings. For example, you might have one copier 
object set up to use letter-size paper and another object set for the same copier, 
but using the legal-size paper tray. Then you could drag a FAX or a document to 
either object, depending on whichever type of paper you'd like to use. This 
would probably be easier than opening up the copier's settings view each tim e 
you wanted to change the paper size. 


Interface Directions: A Summary 


KEY IDEA! 


Nielsen (1993) discusses the future of user interfaces across 
twelve dimensions. The summary chart in Figure 11-1 shows the twelve dimen¬ 
sions and how they are currently embodied in today's interfaces. The last column 
describes the differences that future generation interfaces may have from current 
interface implementations. The author does note that you shouldn't necessarily 
expect all future interfaces to differ from current ones on all of these dimensions 
simultaneously. However, you should expect new interfaces to include changes 
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Current 

Next 


Generation 

Generation 

Dimension 

Interfaces 

Interfaces 

User focus 

Controlling computer 

Controlling task domain 

Computer's role 

Obeying orders literally 

Interpreting user actions and 
doing what is appropriate 

Interface control 

By user (interface is 
explicitly made visible) 

By computer (since user does 
not worry about interface as 
such) 

Syntax 

Object-action composites 

None (no limits or less limited 
interaction syntax) 

Object visibility 

Essential for the use of 
direct manipulation 

Some objects may be implicit 
and hidden 

Interaction stream 

Single device at a time 

Parallel streams from multiple 
devices 

Bandwidth 

Low (keyboard) to 
fairly low (mouse) 

High to very high (virtual 
realities) 

Tracking feedback 

Possible on lexical level 

Needs deep knowledge of 
object semantics 

Turn-taking 

Yes; user and computer 
wait for each other 

No; user and computer both 
keep going 

Interface locus 

Workstation screen, 
mouse, and keyboard 

Embedded in user's environ¬ 
ment, including entire room 
and building 

User programming 

Imperative and poorly 
structured macro 
languages 

Program by demonstration and 
nonimperative, graphical 
languages 

Software packaging 

Monolithic applications 

Plug-and-play modules 


FIGURE 11-1 . Current and Future User Interface Dimensions, from Nielsen (1993) 
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sions in detail, if you are interested in further study in these areas. This article is 
one of the most all-encompassing summaries of future interface technologies I've 
come across. 


A Look Back at the Battlefield 


"More generally, what we call 'user-friendly' software has gotten 
perverted to mean graphical user interfaces, when the real 
definition should be that the software's user interface is 
designed to build on knowledge that the user already has." 

Rob Foshay, 1993 


Windows vs. OS/2: The GUI-OOUI War? Is It Really So? 

Although the war is really one of operating systems, users will win or lose at the 
user interface, as you've realized from reading this book. The war is between 
Microsoft, IBM, Apple, and others for market share of the personal computing 
software operating system environment. The weapons and battlefields in this 
war are the hardware platforms, memory and storage requirements, operating 
system functions, the ability to run existing DOS, Windows, and OS/2 programs, 
and so on. You can see this warlike mentality in the marketing and advertising 
campaigns of most software companies. The target of these campaigns is the 
current and future customers and users of personal appliances, desktop comput¬ 
ers, and workstations, in the home, office, and mobile environments. 

Even the major software developers who create software programs that run 
on these operating systems are swept up in the operating system wars. In an ar¬ 
ticle by Peter Lewis (1993b) called "It Is a Three-Sided Battle, and Confusion 
Reigns—of Course," he quotes Jim Manzi, chairman of Lotus Development Cor¬ 
poration. Manzi, whose company develops software for all the platforms, said, 
"We love them all equally and hate them all equally. Our strategy is operating 
system agnosticism." Manzi's thoughts echo the feelings of most software devel¬ 
opers and many users. 

Much of the battles are at the level of the user interface. This book has cov¬ 
ered both graphical user interfaces (GUIs) and object-oriented interfaces (OOUIs) 
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and their historical background. We're on the front end of a wave of technology 
that will change the way we use computers in the next few years. You've seen 
how human physical, perceptual, and psychological factors influence how users 
perceive and interact with computers. As I said earlier, at the interface, we really 
have evolution rather than revolution. It really isn't a war, it s really about new 
interface concepts and technologies. 

If user interfaces were diverging in vastly different directions, we might have 
a war that could be fought on the functional, technical, and usability fronts. 
However, all the major user interface providers such as Apple, Hewlett-Packard, 
IBM, and Microsoft, are travelling in the same direction, albeit on different tracks, 
at different speeds, starting from different locations, and with different goals! 

The move is on toward object-oriented programs and user interfaces for 
many reasons. Mainly they are easier for programmers to build and maintain, 
and they are easier for users to learn and use to do their work. The goodness of 
all of the competition and technology in the operating system and user interface is 
that computer users will be the beneficiaries of the evolution of both hardware 
and software products. That is, if the designers and programmers of these new 
technology products do as I've discussed here and remember some of my mottos 
for product design, such as "Know thy users, for they are not you," and Iterate, 
iterate, and iterate some more." 


Technology vs. Reality 

"This philosophy further postulates that the ultimate goal of computer 
technology is, in a sense, to make the computer disappear, that the 
technology should be so transparent, so invisible to the user, that for 
practical purposes the computer does not exist. In its perfect form, the 
computer and its application stand outside data content so that 
the user may be completely absorbed in the subject matter. In its 
perfect form, the human interface is entirely that-it allows a person 
to interact with the computer just as if the computer were itself human. 

John Anderson, 1989 
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Future computer-based technologies, such as multimedia, interactive communi¬ 
cations, pen, handwriting, voice, and virtual reality will all be part of the user in¬ 
terface of the future. Unfortunately, new user interface metaphors and paradigms 
evolve very slowly and painfully. Even though technological innovations happen 
quite quickly, they are typically only implemented in small niche markets at first. 
It is difficult for any new technology to have a direct and measurable impact on 
the general computing environment. For example, even today, CD-ROM (Com¬ 
pact Disc Read-Only Memory) storage technology is mature, but only a very 
small percentage (yet the percentage is growing quickly) of PC users have 
CD-ROM capabilities on their computers. 


The Winners and Losers: Users 

"There is more information available at our fingertips during a walk in 
the woods than in any computer system, yet people find a walk among 
trees relaxing and computers frustrating. Machines that fit the 
human environment instead of forcing humans to enter theirs will 
make using a computer as refreshing as taking a walk in the woods." 

Mark Weiser, 1991 


Getting back to the ultimate test of the user interface and consumer frustration, 
let's look at the latest in VCR technology. There is a new breed of VCRs now that 
have incorporated voice technology so users can talk to their VCR to record and 
playback programs and movies. Sounds great, doesn't it? It should be easy 
enough to talk to your VCR, shouldn't it? Simple voice commands such as 
"record", "play", "channel", and saying channel numbers should be easily learned 
and used by everyday household VCR users. However, I've heard that these 
wonderful new machines are accompanied by instruction manuals of over 100 
pages. What we have here is not necessarily an improvement in the VCR user in¬ 
terface, but a trade-off between ease-of-learning and ease-of-use. In using voice 
technology to make VCRs easier to use, it seems we have seriously impacted the 
time it takes users to learn how to use the technology. The potential for im¬ 
proved and intuitive interfaces for consumer products is great, but we haven't yet 
made them easy enough for people to learn and to use. 

The software industry is a very fragile environment. Information Week pub¬ 
lishes a list of the top 50 software vendors. Their latest list (Deninger, 1993) 
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shows that 18 software companies on the top 50 list in 1990 are no longer on the 
list in 1993. What happened to these companies? I don't know the specifics, but 
I'm sure that a lack of attention to users' tasks and interface needs attributed to 
the downfall of some of these companies. The article goes on to say this turmoil 
is part of the evolutionary process of computer software development. They 
stated, "Users, take heart. Would any of you really prefer stability to innovation?" 


KEY IDEA! 


The real question is, how can we make new technology and 
innovation usable for customers and users whose lives are supposed to benefit 
from these products, rather than users having to adapt to these new technologies? 
Let's hope we can accomplish this, and I hope you've learned a little more about 
designing, developing, testing, and using user interfaces in this book. Enjoy 
working with users and user interfaces. Its fun! 


Don't assume that users will automatically become more productive if you 
sit them in front of a new computer with a colorful, graphical user interface. Even 
the tests showing increases in user productivity point out that these increases 
don't come automatically. Ease-of-use often comes at the expense of learning 
time, education, and technical support. Rothke (1993) comments, "Putting GUIs 
in the hands of unmotivated employees is a shortsighted answer to your prob¬ 
lems. Employees must be educated and motivated to exploit that GUI's power. A 
GUI is simply a tool and nothing more, and is only as effective and productive as 
the person using it." 

Don Norman, in a session at the Rethinking Thinking Symposium at the MIT 
Media Lab in 1993, also noted this distinction between machine-centered design 
and human-centered design. The motto for the 1933 Chicago World's Fair was 
"Science finds, industry applies, man conforms.” Norman proposed a future 
motto: "People propose, science studies, technology conforms." Bravo! 

Don't let an interface interfere with people's work and play. Don't forget the 
golden rule of interface design—"Don't do onto others what others have done onto 
you." Remember what you don't like in the interfaces you use. Then make sure 
you don't do the same things in user interfaces you design and develop. 
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Shadows, 260 
Templates, 262-64 
Views, 246 

Open Software Foundation (OSF), 398 
Operating System 
Definition, 22 
OS/2 2.x 
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Arcadia Workplace Companion, 255-56 
Lotus Organizer, 189-91 
Relish, 252-53 

Playroom, by Broderbund Software, Inc., 45-47 
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Usability 

Definition, 14 
Of Information, 16 
Product Marketing, 11-14 
Usability Testing 
Example, 296-98 


Product Design and Development Process, 
299 

OOUI Test Results, 307-8 
Accessing Pop-Up Menus, 309-10 
Creating Template Objects, 312 
Techniques for Opening Object Windows, 
311 

The Benefits of the Graphical User Interface 
(Temple, Barker & Sloane), 302-4 
Usability Problems, 313 
Why do Testing?, 299-300 
User Goals, 40 
User Interface 
Automobile, 20 
Definition, 17 

Front-end for Mainframes, 18-19 
Is there an optimal one?, 42-43 
Look and Feel, 52-53 
User Task Analysis, 124 


V 

Views. See Object Views 
Virtual Reality, 392-95 
Augmented Reality, 394 
Projected Reality, 394 
Total Immersion, 394 
Visual Feedback 

during Drag and Drop, 270-71 
Information Area, 200 
Installation Interfaces, 200 
Progress Indicators, 201 
Status Area, 200 


W 

Windows 

Graphical Extension to DOS, 173 
History, 169-70 

New Technology (NT) Operating System, 
220 

Chicago Project, 220-21 
Windows 3.x 

and OS/2, History , 170-71 
MDI Model, 195 

Windows 3.1 File Manager, 187-88,176 
Windows 3.1 File Manager Icons, 177 


Index 


415 



Windows for Pen Computing (Microsoft), 377 
Workarea, 244-45 

Workgroup Computing (Microsoft), 364-67 
Collaborative User Interface Issues, 365-67 
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